68.7
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2027
- Model
- deepseek/deepseek-v4-flash
- Questions asked
- 101
- Seed
- 2027
- Fingerprint
- dfb61b30bf96f51bd5004aa4
- When
- 2026-09-07T05:51:40.592159+00:00
- Duration
- 3.1 min
- Cost
- 2.59 USD billed
- Tokens
- 167.2k prompt · 1.31M completion · 1.47M total
moonshotai/kimi-k2
mean on this sampled test
· 0.121 USD billed
· 8.7k / 50.6k / 59.2k tok
· 37.5 s / question
61.8
qwen/qwen3.6-flash
mean on this sampled test
· 0.153 USD billed
· 9.7k / 134.8k / 144.5k tok
· 17.9 s / question
52.7
qwen/qwen3.7-flash
mean on this sampled test
· 0.020 USD billed
· 10.4k / 153.5k / 163.9k tok
· 23.5 s / question
51.9
qwen/qwen3.8-flash
mean on this sampled test
· 0.031 USD billed
· 12.9k / 62.3k / 75.1k tok
· 15.3 s / question
63.4
moonshotai/kimi-k2.5
mean on this sampled test
· 0.449 USD billed
· 8.6k / 192.2k / 200.8k tok
· 62.4 s / question
64.1
moonshotai/kimi-k2.6
mean on this sampled test
· 0.361 USD billed
· 8.5k / 112.2k / 120.7k tok
· 62.5 s / question
53.4
google/gemini-2.5-flash
mean on this sampled test
· 0.079 USD billed
· 8.1k / 30.5k / 38.7k tok
· 6.2 s / question
59.5
google/gemini-3.5-flash
mean on this sampled test
· 0.593 USD billed
· 7.8k / 64.6k / 72.4k tok
· 12.2 s / question
59.5
google/gemini-3.6-flash
mean on this sampled test
· 0.244 USD billed
· 8.0k / 63.5k / 71.5k tok
· 11.2 s / question
58.8
google/gemini-3.7-flash
mean on this sampled test
· 0.133 USD billed
· 8.1k / 33.9k / 42.0k tok
· 6.2 s / question
63.4
google/gemini-3.8-flash
mean on this sampled test
· 0.176 USD billed
· 8.3k / 45.4k / 53.7k tok
· 6.7 s / question
64.1
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.045 USD billed
· 10.4k / 172.0k / 182.5k tok
· 19.9 s / question
61.1
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0089 USD billed
· 9.7k / 28.4k / 38.1k tok
· 8.4 s / question
68.7
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.014 USD billed
· 9.2k / 33.7k / 42.9k tok
· 1.8 s / question
62.6
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.028 USD billed
· 8.6k / 17.3k / 25.9k tok
· 2.2 s / question
67.2
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.054 USD billed
· 8.3k / 20.5k / 28.8k tok
· 2.1 s / question
61.8
google/gemini-3-flash-preview
mean on this sampled test
· 0.056 USD billed
· 8.0k / 17.4k / 25.4k tok
· 4.0 s / question
67.9
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.017 USD billed
· 13.8k / 75.0k / 88.9k tok
· 8.6 s / question
66.4