Normalization scale
A task's normalized score is its final result minus the task's floor, divided by the average final result across the models on the roster, so 1 is an average score. A run's final result is the best private score it reached, read off the private split on its own terms rather than through whichever submission led the public board. Both halves of the scale move as rollouts land, so they are frozen (2026-09-02) and reported here rather than recomputed on the fly. A run's whole clock counts toward its final result, whatever length its campaign ran.
The floor is the metric's own lower bound rather than any chosen baseline, and it is zero throughout; aligned SNR, the one metric with no lower bound, clamps there. The divisor is the average of each roster model's mean final result above the floor, per-model means first, so a model that ran more rollouts does not move the scale. A task that runs on more than one board carries a divisor per board, since each board is its own measurement.
| additive-smoothing | judge-gambench-e1-smooth | judge score | 0.00000 | 0.70776 | 21 | 4 |
| attribution-speedup | ar-lat-gpu-bench | graphs/s x memory factor, attribution GPU | 0.00000 | 41.532 | 19 | 5 |
| attribution-speedup | ar-tracer-gpu-bench | graphs/s x memory factor, tracer GPU | 0.00000 | 41.403 | 21 | 5 |
| aux-channel-protocol | joseph-owlbench-for-autoresearch-benchmark | attributed-transfer ladder score | 0.00000 | 0.79146 | 21 | 5 |
| cell-seg | ar-cs-template | mAP over IoU 0.50-0.95 | 0.00000 | 0.36106 | 20 | 5 |
| cheri-triton-training | ar-cheri-for-autoresearch-benchmark | training-step speedup | 0.00000 | 1.876 | 27 | 5 |
| dbscan-speedup | ar-dbscan-cpu-gpu-bench | Mpts/s x memory factor, CPU + GPU | 0.00000 | 150.253 | 21 | 5 |
| ecgdig | ar-ecgdig-bench | aligned SNR (dB) | 0.00000clamped | 6.492 | 17 | 5 |
| hutter | judge-hutter-env-rebuild | compression score, xz 0 to scaled record 1 | 0.00000clamped | 0.31872 | 20 | 5 |
| knowledge-edit | ar-knowledge-edit-bench | gated ratio | 0.00000 | 0.39739 | 15 | 4 |
| lintrack | ar-lintrack-bench | track score | 0.00000 | 0.59714 | 22 | 5 |
| manifold-representation | judge-manifold-representation | judge score | 0.00000 | 0.78556 | 18 | 3 |
| ogbg-code2 | ogbg-code2-full | token-set F1 on the official test split | 0.00000 | 0.19371 | 24 | 5 |
| ogbl-biokg | ogbl-biokg-full | rescaled MRR on the official test split | 0.00000 | 0.85193 | 16 | 4 |
| opcd | ar-opcd-bench | gated ratio | 0.00000 | 0.55565 | 25 | 5 |
| pca-speedup | ar-pca-bench | speedup over full scan x memory factor | 0.00000 | 16.403 | 15 | 5 |
| post-training | ar-post-training-bench | gated ratio | 0.00000 | 0.28016 | 22 | 5 |
| qwen-mtp-speedup | ar-mtp-bench | tokens/s x memory factor | 0.00000 | 26.029 | 19 | 5 |
| reasoning-adapter | ar-reasonadapt-bench | exact-answer accuracy | 0.00000 | 0.64447 | 22 | 5 |
| regulatory-dna-design | joseph-regulatory-dna-design-for-autoresearch-benchmark | held-out expression oracle score | 0.00000 | 0.85903 | 28 | 5 |
| shampoo-parity | ar-shampoo-bench | score on the shipped-to-reference line, unclipped | 0.00000 | 1.160 | 15 | 5 |