96.8
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5401
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5401
- Fingerprint
- 9ee8aa1e9df0f9cd55356789
- When
- 2026-09-18T17:51:47.480181+00:00
- Duration
- 47.3 min
- Cost
- 3.34 USD billed
- Tokens
- 283.4k prompt · 921.1k completion · 1.20M total
x-ai/grok-4.6
mean on this sampled test
· 1.57 USD billed
· 59.6k / 247.2k / 306.7k tok
· 11.6 s / question
96.8
cohere/command-a
mean on this sampled test
· 0.495 USD billed
· 23.8k / 43.6k / 67.4k tok
· 5.0 s / question
83.8
z-ai/glm-5.3-flash
mean on this sampled test
· 0.060 USD billed
· 24.9k / 125.2k / 150.1k tok
· 7.3 s / question
88.0
amazon/nova-premier-v1
mean on this sampled test
· 0.221 USD billed
· 7.7k / 16.2k / 23.8k tok
· 39.2 s / question
14.0
mistralai/devstral-2512
mean on this sampled test
· 0.129 USD billed
· 26.7k / 59.3k / 86.0k tok
· 1.7 s / question
83.6
mistralai/codestral-2508
mean on this sampled test
· 0.047 USD billed
· 24.6k / 43.5k / 68.1k tok
· 1.9 s / question
78.2
thinkingmachines/inkling
mean on this sampled test
· 0.445 USD billed
· 25.5k / 103.7k / 129.2k tok
· 9.7 s / question
89.2
meta-llama/llama-4-maverick
mean on this sampled test
· 0.069 USD billed
· 24.9k / 81.8k / 106.8k tok
· 6.0 s / question
80.0
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.130 USD billed
· 26.7k / 59.4k / 86.1k tok
· 1.7 s / question
86.2
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 13.7k / 27.4k / 41.1k tok
· 39.3 s / question
26.2
thinkingmachines/inkling-small
mean on this sampled test
· 0.149 USD billed
· 25.5k / 113.9k / 139.4k tok
· 2.1 s / question
80.8