98.5
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5426
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5426
- Fingerprint
- 971443aa4260e2405abeab1c
- When
- 2026-09-18T21:55:31.564362+00:00
- Duration
- 52.0 s
- Cost
- 2.94 USD billed
- Tokens
- 277.9k prompt · 856.4k completion · 1.13M total
x-ai/grok-4.6
mean on this sampled test
· 1.44 USD billed
· 59.7k / 224.8k / 284.5k tok
· 11.3 s / question
98.5
cohere/command-a
mean on this sampled test
· 0.482 USD billed
· 23.9k / 42.3k / 66.2k tok
· 4.2 s / question
85.5
z-ai/glm-5.3-flash
mean on this sampled test
· 0.062 USD billed
· 25.1k / 123.8k / 148.8k tok
· 7.2 s / question
89.6
amazon/nova-premier-v1
mean on this sampled test
· 0.0075 USD billed
· 362 / 528 / 890 tok
· 39.3 s / question
0.8
mistralai/devstral-2512
mean on this sampled test
· 0.122 USD billed
· 26.9k / 55.6k / 82.4k tok
· 1.5 s / question
85.7
mistralai/codestral-2508
mean on this sampled test
· 0.042 USD billed
· 24.7k / 38.0k / 62.7k tok
· 1.7 s / question
80.1
thinkingmachines/inkling
mean on this sampled test
· 0.435 USD billed
· 25.7k / 101.1k / 126.8k tok
· 6.8 s / question
87.1
meta-llama/llama-4-maverick
mean on this sampled test
· 0.068 USD billed
· 25.1k / 82.4k / 107.5k tok
· 6.5 s / question
80.3
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.121 USD billed
· 26.9k / 55.2k / 82.1k tok
· 1.6 s / question
88.4
mistralai/mistral-small-2603
mean on this sampled test
· 0.019 USD billed
· 13.9k / 28.3k / 42.2k tok
· 39.3 s / question
27.6
thinkingmachines/inkling-small
mean on this sampled test
· 0.137 USD billed
· 25.7k / 104.4k / 130.1k tok
· 2.4 s / question
84.4