94.3
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- adv-3010
- Model
- anthropic/claude-sonnet-4.6
- Questions asked
- 110
- Seed
- 3010
- Fingerprint
- 4df9a5d4d20caef2b015737f
- When
- 2026-09-10T08:08:19.086783+00:00
- Duration
- 4.9 min
- Cost
- 3.96 USD billed
- Tokens
- 84.7k prompt · 601.7k completion · 686.4k total
openai/gpt-5.4
mean on this sampled test
· 0.263 USD billed
· 14.0k / 15.2k / 29.2k tok
· 2.1 s / question
90.0
openai/o4-mini
mean on this sampled test
· 0.300 USD billed
· 14.0k / 64.8k / 78.8k tok
· 5.3 s / question
92.1
qwen/qwen3-max
mean on this sampled test
· 0.140 USD billed
· 14.6k / 32.9k / 47.6k tok
· 5.1 s / question
86.4
google/gemini-2.5-pro
mean on this sampled test
· 2.44 USD billed
· 13.6k / 242.1k / 255.7k tok
· 20.7 s / question
70.0
deepseek/deepseek-r1-0528
mean on this sampled test
· 0.511 USD billed
· 13.3k / 228.9k / 242.3k tok
· 62.1 s / question
73.6
anthropic/claude-sonnet-4.6
mean on this sampled test
· 0.312 USD billed
· 15.1k / 17.8k / 32.9k tok
· 3.4 s / question
94.3