98.6
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5417
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5417
- Fingerprint
- 08f2a64f67361a7b040eabfe
- When
- 2026-09-18T21:41:16.578819+00:00
- Duration
- 2.8 min
- Cost
- 2.87 USD billed
- Tokens
- 277.8k prompt · 829.3k completion · 1.11M total
x-ai/grok-4.6
mean on this sampled test
· 1.38 USD billed
· 59.7k / 215.8k / 275.4k tok
· 11.3 s / question
98.6
cohere/command-a
mean on this sampled test
· 0.473 USD billed
· 23.9k / 41.4k / 65.2k tok
· 4.2 s / question
85.6
z-ai/glm-5.3-flash
mean on this sampled test
· 0.059 USD billed
· 25.1k / 116.2k / 141.3k tok
· 6.5 s / question
91.1
amazon/nova-premier-v1
mean on this sampled test
· 0.042 USD billed
· 1.6k / 3.0k / 4.6k tok
· 39.2 s / question
2.9
mistralai/devstral-2512
mean on this sampled test
· 0.121 USD billed
· 26.8k / 55.4k / 82.2k tok
· 1.6 s / question
84.9
mistralai/codestral-2508
mean on this sampled test
· 0.043 USD billed
· 24.7k / 39.7k / 64.4k tok
· 1.8 s / question
82.7
thinkingmachines/inkling
mean on this sampled test
· 0.411 USD billed
· 25.6k / 95.2k / 120.9k tok
· 6.4 s / question
88.9
meta-llama/llama-4-maverick
mean on this sampled test
· 0.067 USD billed
· 25.1k / 80.0k / 105.1k tok
· 6.1 s / question
79.4
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.121 USD billed
· 26.8k / 55.2k / 82.0k tok
· 1.6 s / question
87.8
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 12.8k / 26.8k / 39.6k tok
· 39.2 s / question
26.8
thinkingmachines/inkling-small
mean on this sampled test
· 0.133 USD billed
· 25.7k / 100.7k / 126.4k tok
· 2.5 s / question
85.6