71.8
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2022
- Model
- deepseek/deepseek-v4-flash
- Questions asked
- 101
- Seed
- 2022
- Fingerprint
- 52c1ffdfca8788ab24bb7632
- When
- 2026-09-07T04:47:01.148698+00:00
- Duration
- 12.5 min
- Cost
- 2.62 USD billed
- Tokens
- 174.6k prompt · 1.31M completion · 1.48M total
moonshotai/kimi-k2
mean on this sampled test
· 0.099 USD billed
· 9.3k / 40.8k / 50.1k tok
· 16.3 s / question
67.2
qwen/qwen3.6-flash
mean on this sampled test
· 0.166 USD billed
· 10.0k / 145.8k / 155.8k tok
· 18.4 s / question
52.7
qwen/qwen3.7-flash
mean on this sampled test
· 0.023 USD billed
· 10.8k / 177.6k / 188.4k tok
· 25.4 s / question
50.4
qwen/qwen3.8-flash
mean on this sampled test
· 0.024 USD billed
· 12.9k / 47.6k / 60.4k tok
· 9.6 s / question
64.9
moonshotai/kimi-k2.5
mean on this sampled test
· 0.431 USD billed
· 9.2k / 187.2k / 196.4k tok
· 62.4 s / question
65.6
moonshotai/kimi-k2.6
mean on this sampled test
· 0.312 USD billed
· 8.7k / 95.4k / 104.2k tok
· 46.1 s / question
57.3
google/gemini-2.5-flash
mean on this sampled test
· 0.092 USD billed
· 8.7k / 35.8k / 44.5k tok
· 6.1 s / question
62.6
google/gemini-3.5-flash
mean on this sampled test
· 0.638 USD billed
· 8.4k / 69.4k / 77.8k tok
· 9.4 s / question
61.8
google/gemini-3.6-flash
mean on this sampled test
· 0.270 USD billed
· 8.8k / 70.3k / 79.1k tok
· 9.3 s / question
63.4
google/gemini-3.7-flash
mean on this sampled test
· 0.144 USD billed
· 8.8k / 36.7k / 45.5k tok
· 5.7 s / question
67.9
google/gemini-3.8-flash
mean on this sampled test
· 0.170 USD billed
· 8.8k / 43.7k / 52.5k tok
· 5.6 s / question
67.2
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.045 USD billed
· 10.4k / 168.6k / 179.0k tok
· 21.1 s / question
61.8
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0094 USD billed
· 9.9k / 29.9k / 39.8k tok
· 9.5 s / question
71.8
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.021 USD billed
· 9.3k / 50.1k / 59.5k tok
· 2.7 s / question
62.6
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.034 USD billed
· 8.9k / 20.9k / 29.9k tok
· 2.3 s / question
67.9
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.063 USD billed
· 8.7k / 24.1k / 32.8k tok
· 2.3 s / question
63.4
google/gemini-3-flash-preview
mean on this sampled test
· 0.064 USD billed
· 8.6k / 19.9k / 28.6k tok
· 4.0 s / question
70.2
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.011 USD billed
· 14.5k / 45.6k / 60.1k tok
· 5.1 s / question
71.0