98.2
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5402
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5402
- Fingerprint
- f0c474a8b8ea0363aae59097
- When
- 2026-09-18T18:13:18.721546+00:00
- Duration
- 21.5 min
- Cost
- 3.08 USD billed
- Tokens
- 276.7k prompt · 883.1k completion · 1.16M total
x-ai/grok-4.6
mean on this sampled test
· 1.49 USD billed
· 59.5k / 233.9k / 293.4k tok
· 11.9 s / question
98.2
cohere/command-a
mean on this sampled test
· 0.509 USD billed
· 23.8k / 45.0k / 68.8k tok
· 4.6 s / question
87.6
z-ai/glm-5.3-flash
mean on this sampled test
· 0.059 USD billed
· 24.9k / 118.2k / 143.1k tok
· 6.7 s / question
90.5
amazon/nova-premier-v1
mean on this sampled test
· 0.043 USD billed
· 1.7k / 3.1k / 4.8k tok
· 39.3 s / question
2.4
mistralai/devstral-2512
mean on this sampled test
· 0.131 USD billed
· 26.7k / 60.2k / 86.9k tok
· 1.6 s / question
84.8
mistralai/codestral-2508
mean on this sampled test
· 0.047 USD billed
· 24.6k / 44.3k / 68.9k tok
· 1.8 s / question
81.1
thinkingmachines/inkling
mean on this sampled test
· 0.443 USD billed
· 25.5k / 103.3k / 128.8k tok
· 9.4 s / question
90.3
meta-llama/llama-4-maverick
mean on this sampled test
· 0.070 USD billed
· 25.0k / 83.0k / 108.0k tok
· 6.7 s / question
79.5
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.131 USD billed
· 26.7k / 59.9k / 86.7k tok
· 1.6 s / question
87.4
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 12.8k / 26.3k / 39.1k tok
· 39.4 s / question
26.8
thinkingmachines/inkling-small
mean on this sampled test
· 0.139 USD billed
· 25.5k / 105.9k / 131.4k tok
· 2.0 s / question
85.2