90.8
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2006
- Model
- deepseek/deepseek-v4-flash-0731
- Questions asked
- 101
- Seed
- 2006
- Fingerprint
- e84cf0e8402320641be758a0
- When
- 2026-09-06T22:51:44.053129+00:00
- Duration
- 69.9 min
- Cost
- 2.54 USD billed
- Tokens
- 186.8k prompt · 1.30M completion · 1.49M total
moonshotai/kimi-k2
mean on this sampled test
· 0.106 USD billed
· 9.5k / 43.7k / 53.2k tok
· 13.8 s / question
69.5
qwen/qwen3.6-flash
mean on this sampled test
· 0.160 USD billed
· 10.1k / 140.4k / 150.5k tok
· 16.2 s / question
55.0
qwen/qwen3.7-flash
mean on this sampled test
· 0.025 USD billed
· 12.4k / 188.8k / 201.2k tok
· 23.4 s / question
57.3
qwen/qwen3.8-flash
mean on this sampled test
· 0.025 USD billed
· 13.3k / 49.2k / 62.5k tok
· 10.4 s / question
67.2
moonshotai/kimi-k2.5
mean on this sampled test
· 0.426 USD billed
· 9.5k / 182.5k / 192.0k tok
· 62.4 s / question
69.5
moonshotai/kimi-k2.6
mean on this sampled test
· 0.287 USD billed
· 9.3k / 87.0k / 96.3k tok
· 23.9 s / question
61.8
google/gemini-2.5-flash
mean on this sampled test
· 0.085 USD billed
· 8.8k / 33.1k / 41.9k tok
· 4.6 s / question
64.9
google/gemini-3.5-flash
mean on this sampled test
· 0.626 USD billed
· 8.7k / 68.1k / 76.8k tok
· 8.2 s / question
64.9
google/gemini-3.6-flash
mean on this sampled test
· 0.254 USD billed
· 8.7k / 66.1k / 74.8k tok
· 8.8 s / question
63.4
google/gemini-3.7-flash
mean on this sampled test
· 0.137 USD billed
· 8.7k / 34.7k / 43.4k tok
· 5.6 s / question
68.7
google/gemini-3.8-flash
mean on this sampled test
· 0.166 USD billed
· 8.7k / 42.5k / 51.2k tok
· 5.6 s / question
67.9
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.048 USD billed
· 11.4k / 180.6k / 192.0k tok
· 19.0 s / question
66.4
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0097 USD billed
· 11.2k / 32.1k / 43.4k tok
· 7.2 s / question
80.2
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.017 USD billed
· 9.9k / 39.0k / 48.9k tok
· 1.9 s / question
68.7
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.031 USD billed
· 8.9k / 19.1k / 28.0k tok
· 2.2 s / question
68.7
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.060 USD billed
· 8.8k / 23.1k / 31.9k tok
· 1.9 s / question
66.4
google/gemini-3-flash-preview
mean on this sampled test
· 0.061 USD billed
· 8.8k / 19.0k / 27.8k tok
· 3.5 s / question
72.5
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.011 USD billed
· 20.3k / 52.4k / 72.7k tok
· 2.5 s / question
90.8