98.4
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5427
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5427
- Fingerprint
- a368e0ab3f8e29402c3a470d
- When
- 2026-09-18T21:57:04.382496+00:00
- Duration
- 1.5 min
- Cost
- 3.07 USD billed
- Tokens
- 279.2k prompt · 885.4k completion · 1.16M total
x-ai/grok-4.6
mean on this sampled test
· 1.53 USD billed
· 59.8k / 239.4k / 299.2k tok
· 11.6 s / question
98.4
cohere/command-a
mean on this sampled test
· 0.494 USD billed
· 24.1k / 43.4k / 67.5k tok
· 4.6 s / question
85.3
z-ai/glm-5.3-flash
mean on this sampled test
· 0.062 USD billed
· 25.2k / 122.4k / 147.6k tok
· 6.8 s / question
87.3
amazon/nova-premier-v1
mean on this sampled test
· 0.021 USD billed
· 719 / 1.5k / 2.2k tok
· 39.3 s / question
2.0
mistralai/devstral-2512
mean on this sampled test
· 0.126 USD billed
· 27.1k / 57.8k / 84.9k tok
· 1.5 s / question
85.9
mistralai/codestral-2508
mean on this sampled test
· 0.045 USD billed
· 24.9k / 41.7k / 66.7k tok
· 1.8 s / question
79.6
thinkingmachines/inkling
mean on this sampled test
· 0.442 USD billed
· 25.8k / 102.8k / 128.6k tok
· 9.7 s / question
87.7
meta-llama/llama-4-maverick
mean on this sampled test
· 0.068 USD billed
· 25.3k / 81.8k / 107.1k tok
· 6.1 s / question
79.4
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.126 USD billed
· 27.1k / 57.6k / 84.7k tok
· 1.6 s / question
88.7
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 13.4k / 27.3k / 40.8k tok
· 39.3 s / question
29.1
thinkingmachines/inkling-small
mean on this sampled test
· 0.144 USD billed
· 25.8k / 109.7k / 135.5k tok
· 2.4 s / question
82.4