94.3
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- adv-3007
- Model
- anthropic/claude-sonnet-4.6
- Questions asked
- 110
- Seed
- 3007
- Fingerprint
- b0101a7b6ec127371bd4c297
- When
- 2026-09-10T07:50:45.655347+00:00
- Duration
- 5.6 min
- Cost
- 3.84 USD billed
- Tokens
- 87.7k prompt · 574.9k completion · 662.7k total
openai/gpt-5.4
mean on this sampled test
· 0.242 USD billed
· 14.5k / 13.7k / 28.3k tok
· 2.1 s / question
91.4
openai/o4-mini
mean on this sampled test
· 0.285 USD billed
· 14.5k / 61.1k / 75.6k tok
· 4.9 s / question
92.9
qwen/qwen3-max
mean on this sampled test
· 0.140 USD billed
· 15.1k / 32.9k / 48.0k tok
· 5.2 s / question
87.9
google/gemini-2.5-pro
mean on this sampled test
· 2.43 USD billed
· 14.0k / 241.1k / 255.1k tok
· 20.7 s / question
71.4
deepseek/deepseek-r1-0528
mean on this sampled test
· 0.474 USD billed
· 13.8k / 211.3k / 225.1k tok
· 62.1 s / question
75.0
anthropic/claude-sonnet-4.6
mean on this sampled test
· 0.270 USD billed
· 15.6k / 14.9k / 30.5k tok
· 3.2 s / question
94.3