97.4
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- wave6-5415
- Model
- x-ai/grok-4.6
- Questions asked
- 177
- Seed
- 5415
- Fingerprint
- 366373e3d3311dce39ec294d
- When
- 2026-09-18T21:35:13.153259+00:00
- Duration
- 3.8 min
- Cost
- 3.00 USD billed
- Tokens
- 278.1k prompt · 864.6k completion · 1.14M total
x-ai/grok-4.6
mean on this sampled test
· 1.48 USD billed
· 59.7k / 230.8k / 290.5k tok
· 11.0 s / question
97.4
cohere/command-a
mean on this sampled test
· 0.479 USD billed
· 23.9k / 41.9k / 65.9k tok
· 4.3 s / question
85.9
z-ai/glm-5.3-flash
mean on this sampled test
· 0.060 USD billed
· 25.1k / 118.4k / 143.5k tok
· 6.6 s / question
86.3
amazon/nova-premier-v1
mean on this sampled test
· 0.034 USD billed
· 1.0k / 2.5k / 3.5k tok
· 39.3 s / question
2.0
mistralai/devstral-2512
mean on this sampled test
· 0.124 USD billed
· 26.9k / 56.9k / 83.8k tok
· 1.6 s / question
85.3
mistralai/codestral-2508
mean on this sampled test
· 0.044 USD billed
· 24.8k / 40.7k / 65.5k tok
· 1.7 s / question
81.1
thinkingmachines/inkling
mean on this sampled test
· 0.431 USD billed
· 25.7k / 100.3k / 126.0k tok
· 6.6 s / question
86.9
meta-llama/llama-4-maverick
mean on this sampled test
· 0.068 USD billed
· 25.1k / 81.7k / 106.8k tok
· 6.5 s / question
79.7
mistralai/mistral-medium-3.1
mean on this sampled test
· 0.123 USD billed
· 26.9k / 56.4k / 83.3k tok
· 1.6 s / question
88.0
mistralai/mistral-small-2603
mean on this sampled test
· 0.018 USD billed
· 13.2k / 27.3k / 40.5k tok
· 39.3 s / question
27.1
thinkingmachines/inkling-small
mean on this sampled test
· 0.141 USD billed
· 25.7k / 107.7k / 133.5k tok
· 2.2 s / question
81.7