97.1
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5411
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5411
- Fingerprint
- 6cab9ef5f8f39dcc184b849b
- When
- 2026-09-18T21:18:26.489716+00:00
- Duration
- 5.2 min
- Cost
- 2.92 USD billed
- Tokens
- 276.1k prompt · 850.8k completion · 1.13M total
x-ai/grok-4.6
mean on this sampled test
· 1.41 USD billed
· 59.4k / 219.6k / 279.0k tok
· 11.3 s / question
97.1
cohere/command-a
mean on this sampled test
· 0.499 USD billed
· 23.7k / 44.0k / 67.6k tok
· 4.6 s / question
85.3
z-ai/glm-5.3-flash
mean on this sampled test
· 0.061 USD billed
· 24.8k / 120.3k / 145.1k tok
· 6.1 s / question
88.8
amazon/nova-premier-v1
mean on this sampled test
· 0.026 USD billed
· 881 / 1.9k / 2.8k tok
· 39.2 s / question
2.0
mistralai/devstral-2512
mean on this sampled test
· 0.126 USD billed
· 26.6k / 57.5k / 84.2k tok
· 1.4 s / question
82.4
mistralai/codestral-2508
mean on this sampled test
· 0.045 USD billed
· 24.5k / 41.9k / 66.4k tok
· 1.8 s / question
80.4
thinkingmachines/inkling
mean on this sampled test
· 0.416 USD billed
· 25.3k / 96.5k / 121.9k tok
· 7.6 s / question
88.8
meta-llama/llama-4-maverick
mean on this sampled test
· 0.066 USD billed
· 24.8k / 79.2k / 104.0k tok
· 6.6 s / question
79.2
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.125 USD billed
· 26.6k / 57.0k / 83.6k tok
· 1.6 s / question
85.1
mistralai/mistral-small-2603
mean on this sampled test
· 0.020 USD billed
· 14.1k / 29.3k / 43.4k tok
· 39.2 s / question
28.0
thinkingmachines/inkling-small
mean on this sampled test
· 0.136 USD billed
· 25.4k / 103.6k / 129.0k tok
· 2.7 s / question
84.7