98.6
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5419
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5419
- Fingerprint
- a5839ddec36759c42cf260fc
- When
- 2026-09-18T21:44:19.958813+00:00
- Duration
- 1.6 min
- Cost
- 2.91 USD billed
- Tokens
- 281.0k prompt · 842.9k completion · 1.12M total
x-ai/grok-4.6
mean on this sampled test
· 1.41 USD billed
· 59.9k / 219.0k / 278.9k tok
· 11.6 s / question
98.6
cohere/command-a
mean on this sampled test
· 0.477 USD billed
· 24.2k / 41.7k / 65.9k tok
· 4.2 s / question
87.4
z-ai/glm-5.3-flash
mean on this sampled test
· 0.058 USD billed
· 25.3k / 117.1k / 142.4k tok
· 6.3 s / question
90.9
amazon/nova-premier-v1
mean on this sampled test
· 0.053 USD billed
· 1.6k / 4.0k / 5.5k tok
· 39.2 s / question
2.7
mistralai/devstral-2512
mean on this sampled test
· 0.126 USD billed
· 27.1k / 57.4k / 84.5k tok
· 1.5 s / question
85.6
mistralai/codestral-2508
mean on this sampled test
· 0.043 USD billed
· 24.9k / 39.5k / 64.4k tok
· 1.8 s / question
81.9
thinkingmachines/inkling
mean on this sampled test
· 0.402 USD billed
· 25.9k / 93.0k / 118.8k tok
· 6.4 s / question
90.5
meta-llama/llama-4-maverick
mean on this sampled test
· 0.067 USD billed
· 25.3k / 80.6k / 105.9k tok
· 6.1 s / question
81.9
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.125 USD billed
· 27.1k / 56.9k / 84.0k tok
· 1.6 s / question
88.7
mistralai/mistral-small-2603
mean on this sampled test
· 0.020 USD billed
· 14.0k / 29.4k / 43.3k tok
· 39.3 s / question
28.0
thinkingmachines/inkling-small
mean on this sampled test
· 0.138 USD billed
· 25.9k / 104.4k / 130.3k tok
· 2.6 s / question
85.0