98.4
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5414
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5414
- Fingerprint
- f0da13054b1fc6b0ff689e87
- When
- 2026-09-18T21:31:22.213753+00:00
- Duration
- 3.4 min
- Cost
- 3.02 USD billed
- Tokens
- 276.0k prompt · 869.5k completion · 1.15M total
x-ai/grok-4.6
mean on this sampled test
· 1.47 USD billed
· 59.4k / 229.9k / 289.3k tok
· 11.7 s / question
98.4
cohere/command-a
mean on this sampled test
· 0.484 USD billed
· 23.6k / 42.5k / 66.2k tok
· 4.3 s / question
85.4
z-ai/glm-5.3-flash
mean on this sampled test
· 0.062 USD billed
· 24.8k / 124.0k / 148.7k tok
· 6.6 s / question
88.6
amazon/nova-premier-v1
mean on this sampled test
· 0.049 USD billed
· 1.6k / 3.6k / 5.2k tok
· 39.3 s / question
4.0
mistralai/devstral-2512
mean on this sampled test
· 0.127 USD billed
· 26.6k / 58.0k / 84.6k tok
· 1.5 s / question
83.6
mistralai/codestral-2508
mean on this sampled test
· 0.046 USD billed
· 24.5k / 42.8k / 67.2k tok
· 1.8 s / question
80.6
thinkingmachines/inkling
mean on this sampled test
· 0.429 USD billed
· 25.3k / 99.8k / 125.2k tok
· 6.8 s / question
89.2
meta-llama/llama-4-maverick
mean on this sampled test
· 0.068 USD billed
· 24.8k / 81.0k / 105.9k tok
· 6.1 s / question
81.0
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.126 USD billed
· 26.6k / 57.8k / 84.4k tok
· 1.6 s / question
87.2
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 13.5k / 26.1k / 39.6k tok
· 39.3 s / question
27.7
thinkingmachines/inkling-small
mean on this sampled test
· 0.137 USD billed
· 25.4k / 103.9k / 129.3k tok
· 2.2 s / question
84.6