95.7
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- adv-3004
- Model
- anthropic/claude-sonnet-4.6
- Questions asked
- 110
- Seed
- 3004
- Fingerprint
- 2cf3fe808e61b981bf2dc387
- When
- 2026-09-10T07:27:00.757486+00:00
- Duration
- 11.2 min
- Cost
- 3.92 USD billed
- Tokens
- 87.7k prompt · 596.1k completion · 683.8k total
openai/gpt-5.4
mean on this sampled test
· 0.238 USD billed
· 14.5k / 13.5k / 27.9k tok
· 2.1 s / question
90.7
openai/o4-mini
mean on this sampled test
· 0.288 USD billed
· 14.5k / 61.9k / 76.4k tok
· 4.8 s / question
93.6
qwen/qwen3-max
mean on this sampled test
· 0.145 USD billed
· 15.1k / 34.1k / 49.2k tok
· 5.1 s / question
88.6
google/gemini-2.5-pro
mean on this sampled test
· 2.47 USD billed
· 14.0k / 246.1k / 260.1k tok
· 20.9 s / question
71.4
deepseek/deepseek-r1-0528
mean on this sampled test
· 0.503 USD billed
· 14.0k / 225.5k / 239.6k tok
· 63.9 s / question
74.3
anthropic/claude-sonnet-4.6
mean on this sampled test
· 0.272 USD billed
· 15.6k / 15.0k / 30.6k tok
· 2.9 s / question
95.7