OmniEvaluator Dashboard

INTERNAL

Submission

Models are auto-detected from configured sources.

Internal Path

Set OMNI_INTERNAL_OUTPUTS_PATH to change.

Loading...

Direct Upload

Upload a .zip result package. Stored in OMNI_INTERNAL_UPLOAD_DIR.

Click or drop .zip

S3

Set S3_ACCESS_KEY, S3_SECRET_KEY, S3_BUCKET_NAME to configure.

Loading...

Model List

Internal Path

Direct Upload

S3

Leaderboard

Model Mode
Filter models by debug prefix.
Sources
Filter rows by data source.
Modality
Filter benchmarks by input modality.
Inference Engine
Filter rows by inference backend.
Evaluation Engine
Filter benchmark columns only.
Value
Choose score/time/coverage and sub-metrics.
Options
Avg, OmniScore, normalization, and merge toggles.
Benchmarks

Inference Viewer

Select models by source, then choose a benchmark to view sample-level predictions.

Model Selection

Internal Path

Direct Upload

S3 Source

Select Benchmark

Benchmarks
Selected Select benchmark

Inference Viewer