73.3
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2007
- Model
- deepseek/deepseek-v4-flash
- Questions asked
- 101
- Seed
- 2007
- Fingerprint
- ff982ef6b4b1c64f779c44bb
- When
- 2026-09-06T23:53:12.952564+00:00
- Duration
- 61.5 min
- Cost
- 2.82 USD billed
- Tokens
- 186.1k prompt · 1.36M completion · 1.54M total
moonshotai/kimi-k2
mean on this sampled test
· 0.125 USD billed
· 10.0k / 51.8k / 61.8k tok
· 13.5 s / question
69.5
qwen/qwen3.6-flash
mean on this sampled test
· 0.161 USD billed
· 10.8k / 141.5k / 152.2k tok
· 13.7 s / question
58.8
qwen/qwen3.7-flash
mean on this sampled test
· 0.022 USD billed
· 11.3k / 166.1k / 177.4k tok
· 21.8 s / question
54.2
qwen/qwen3.8-flash
mean on this sampled test
· 0.028 USD billed
· 13.5k / 54.2k / 67.7k tok
· 11.4 s / question
66.4
moonshotai/kimi-k2.5
mean on this sampled test
· 0.504 USD billed
· 9.8k / 211.7k / 221.5k tok
· 62.4 s / question
69.5
moonshotai/kimi-k2.6
mean on this sampled test
· 0.352 USD billed
· 9.8k / 104.6k / 114.3k tok
· 33.8 s / question
61.8
google/gemini-2.5-flash
mean on this sampled test
· 0.101 USD billed
· 9.4k / 39.2k / 48.6k tok
· 4.8 s / question
65.6
google/gemini-3.5-flash
mean on this sampled test
· 0.691 USD billed
· 9.1k / 75.2k / 84.3k tok
· 8.0 s / question
65.6
google/gemini-3.6-flash
mean on this sampled test
· 0.276 USD billed
· 9.2k / 71.7k / 81.0k tok
· 7.7 s / question
64.1
google/gemini-3.7-flash
mean on this sampled test
· 0.139 USD billed
· 9.4k / 35.1k / 44.5k tok
· 4.9 s / question
70.2
google/gemini-3.8-flash
mean on this sampled test
· 0.173 USD billed
· 9.4k / 44.3k / 53.7k tok
· 4.8 s / question
69.5
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.045 USD billed
· 11.1k / 171.9k / 183.0k tok
· 20.8 s / question
64.9
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0090 USD billed
· 10.6k / 29.5k / 40.1k tok
· 7.8 s / question
73.3
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.018 USD billed
· 9.8k / 42.0k / 51.8k tok
· 1.9 s / question
65.6
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.033 USD billed
· 9.5k / 20.1k / 29.6k tok
· 2.0 s / question
71.0
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.063 USD billed
· 9.4k / 24.1k / 33.5k tok
· 1.8 s / question
66.4
google/gemini-3-flash-preview
mean on this sampled test
· 0.066 USD billed
· 9.2k / 20.4k / 29.7k tok
· 3.5 s / question
73.3
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.015 USD billed
· 15.0k / 53.1k / 68.1k tok
· 4.7 s / question
70.2