97.9
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5405
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5405
- Fingerprint
- 0ca3d8943bf01ec3d516df6b
- When
- 2026-09-18T18:52:41.833324+00:00
- Duration
- 11.2 min
- Cost
- 2.90 USD billed
- Tokens
- 275.8k prompt · 849.5k completion · 1.13M total
x-ai/grok-4.6
mean on this sampled test
· 1.38 USD billed
· 59.5k / 214.4k / 273.9k tok
· 10.8 s / question
97.9
cohere/command-a
mean on this sampled test
· 0.495 USD billed
· 23.7k / 43.6k / 67.2k tok
· 4.5 s / question
86.0
z-ai/glm-5.3-flash
mean on this sampled test
· 0.060 USD billed
· 24.9k / 119.3k / 144.1k tok
· 6.5 s / question
88.2
amazon/nova-premier-v1
mean on this sampled test
· 0.023 USD billed
· 866 / 1.7k / 2.5k tok
· 39.3 s / question
1.2
mistralai/devstral-2512
mean on this sampled test
· 0.123 USD billed
· 26.6k / 56.4k / 83.1k tok
· 1.6 s / question
84.7
mistralai/codestral-2508
mean on this sampled test
· 0.046 USD billed
· 24.5k / 42.6k / 67.1k tok
· 1.9 s / question
80.2
thinkingmachines/inkling
mean on this sampled test
· 0.423 USD billed
· 25.4k / 98.4k / 123.9k tok
· 7.7 s / question
87.8
meta-llama/llama-4-maverick
mean on this sampled test
· 0.069 USD billed
· 24.9k / 82.4k / 107.3k tok
· 6.0 s / question
80.6
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.124 USD billed
· 26.6k / 56.5k / 83.1k tok
· 1.7 s / question
87.2
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 13.3k / 27.2k / 40.4k tok
· 39.3 s / question
27.2
thinkingmachines/inkling-small
mean on this sampled test
· 0.141 USD billed
· 25.5k / 107.1k / 132.6k tok
· 2.1 s / question
82.7