98.2
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5416
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5416
- Fingerprint
- c4fdeae1645e8ae0f98c94b0
- When
- 2026-09-18T21:38:27.013677+00:00
- Duration
- 3.2 min
- Cost
- 2.90 USD billed
- Tokens
- 275.2k prompt · 833.0k completion · 1.11M total
x-ai/grok-4.6
mean on this sampled test
· 1.39 USD billed
· 59.4k / 217.3k / 276.8k tok
· 11.3 s / question
98.2
cohere/command-a
mean on this sampled test
· 0.484 USD billed
· 23.6k / 42.5k / 66.1k tok
· 4.3 s / question
84.9
z-ai/glm-5.3-flash
mean on this sampled test
· 0.061 USD billed
· 24.7k / 118.9k / 143.6k tok
· 6.4 s / question
86.5
amazon/nova-premier-v1
mean on this sampled test
· 0.036 USD billed
· 1.2k / 2.6k / 3.8k tok
· 39.3 s / question
3.2
mistralai/devstral-2512
mean on this sampled test
· 0.123 USD billed
· 26.6k / 56.4k / 83.0k tok
· 1.5 s / question
82.3
mistralai/codestral-2508
mean on this sampled test
· 0.044 USD billed
· 24.4k / 40.8k / 65.3k tok
· 1.9 s / question
80.9
thinkingmachines/inkling
mean on this sampled test
· 0.418 USD billed
· 25.3k / 97.1k / 122.5k tok
· 8.3 s / question
89.2
meta-llama/llama-4-maverick
mean on this sampled test
· 0.065 USD billed
· 24.8k / 77.6k / 102.4k tok
· 6.0 s / question
80.3
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.124 USD billed
· 26.6k / 56.5k / 83.1k tok
· 1.5 s / question
85.5
mistralai/mistral-small-2603
mean on this sampled test
· 0.017 USD billed
· 13.1k / 25.9k / 39.0k tok
· 39.3 s / question
29.1
thinkingmachines/inkling-small
mean on this sampled test
· 0.129 USD billed
· 25.4k / 97.3k / 122.6k tok
· 2.3 s / question
84.1