74.0
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2023
- Model
- deepseek/deepseek-v4-flash
- Questions asked
- 101
- Seed
- 2023
- Fingerprint
- 4f07ae1b05157d43566dc334
- When
- 2026-09-07T04:50:10.919800+00:00
- Duration
- 3.1 min
- Cost
- 2.70 USD billed
- Tokens
- 187.0k prompt · 1.34M completion · 1.53M total
moonshotai/kimi-k2
mean on this sampled test
· 0.122 USD billed
· 10.0k / 50.7k / 60.7k tok
· 13.0 s / question
71.0
qwen/qwen3.6-flash
mean on this sampled test
· 0.162 USD billed
· 10.9k / 142.6k / 153.5k tok
· 14.4 s / question
59.5
qwen/qwen3.7-flash
mean on this sampled test
· 0.021 USD billed
· 11.3k / 156.0k / 167.3k tok
· 20.6 s / question
57.3
qwen/qwen3.8-flash
mean on this sampled test
· 0.029 USD billed
· 13.9k / 56.9k / 70.8k tok
· 10.6 s / question
67.9
moonshotai/kimi-k2.5
mean on this sampled test
· 0.474 USD billed
· 10.0k / 203.4k / 213.3k tok
· 62.4 s / question
70.2
moonshotai/kimi-k2.6
mean on this sampled test
· 0.405 USD billed
· 10.0k / 131.7k / 141.7k tok
· 34.5 s / question
61.8
google/gemini-2.5-flash
mean on this sampled test
· 0.092 USD billed
· 9.4k / 35.6k / 45.0k tok
· 4.8 s / question
66.4
google/gemini-3.5-flash
mean on this sampled test
· 0.609 USD billed
· 9.1k / 66.1k / 75.2k tok
· 8.0 s / question
67.2
google/gemini-3.6-flash
mean on this sampled test
· 0.241 USD billed
· 9.0k / 62.4k / 71.4k tok
· 7.3 s / question
64.9
google/gemini-3.7-flash
mean on this sampled test
· 0.139 USD billed
· 9.4k / 35.2k / 44.5k tok
· 5.3 s / question
71.0
google/gemini-3.8-flash
mean on this sampled test
· 0.179 USD billed
· 9.4k / 45.9k / 55.3k tok
· 4.6 s / question
71.0
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.045 USD billed
· 11.3k / 171.5k / 182.8k tok
· 17.5 s / question
66.4
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0089 USD billed
· 10.3k / 28.6k / 38.9k tok
· 7.0 s / question
74.0
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.017 USD billed
· 9.9k / 39.9k / 49.8k tok
· 2.0 s / question
67.2
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.031 USD billed
· 9.7k / 19.1k / 28.7k tok
· 1.8 s / question
72.5
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.056 USD billed
· 9.4k / 21.3k / 30.6k tok
· 1.7 s / question
66.4
google/gemini-3-flash-preview
mean on this sampled test
· 0.062 USD billed
· 9.2k / 19.1k / 28.4k tok
· 3.1 s / question
74.0
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.011 USD billed
· 14.9k / 54.3k / 69.2k tok
· 4.7 s / question
70.2