97.4
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5407
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5407
- Fingerprint
- 599d2e9de9759eb5ab75d8d0
- When
- 2026-09-18T20:14:48.082173+00:00
- Duration
- 9.5 min
- Cost
- 2.95 USD billed
- Tokens
- 280.5k prompt · 861.2k completion · 1.14M total
x-ai/grok-4.6
mean on this sampled test
· 1.43 USD billed
· 59.8k / 222.9k / 282.6k tok
· 11.0 s / question
97.4
cohere/command-a
mean on this sampled test
· 0.472 USD billed
· 24.0k / 41.2k / 65.2k tok
· 4.3 s / question
82.8
z-ai/glm-5.3-flash
mean on this sampled test
· 0.060 USD billed
· 25.2k / 121.2k / 146.4k tok
· 6.5 s / question
87.6
amazon/nova-premier-v1
mean on this sampled test
· 0.051 USD billed
· 1.6k / 3.8k / 5.4k tok
· 39.3 s / question
3.4
mistralai/devstral-2512
mean on this sampled test
· 0.123 USD billed
· 27.0k / 55.9k / 82.9k tok
· 1.5 s / question
80.7
mistralai/codestral-2508
mean on this sampled test
· 0.047 USD billed
· 24.9k / 43.8k / 68.7k tok
· 1.7 s / question
77.1
thinkingmachines/inkling
mean on this sampled test
· 0.416 USD billed
· 25.8k / 96.4k / 122.2k tok
· 9.7 s / question
87.4
meta-llama/llama-4-maverick
mean on this sampled test
· 0.067 USD billed
· 25.2k / 80.0k / 105.2k tok
· 6.5 s / question
77.3
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.123 USD billed
· 27.0k / 56.0k / 83.0k tok
· 1.6 s / question
86.4
mistralai/mistral-small-2603
mean on this sampled test
· 0.020 USD billed
· 14.4k / 29.2k / 43.6k tok
· 39.3 s / question
29.0
thinkingmachines/inkling-small
mean on this sampled test
· 0.145 USD billed
· 25.8k / 110.7k / 136.5k tok
· 2.5 s / question
80.9