69.5
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2016
- Model
- deepseek/deepseek-v4-flash
- Questions asked
- 101
- Seed
- 2016
- Fingerprint
- 68bb476de3d37078c3bc9914
- When
- 2026-09-07T03:50:23.806212+00:00
- Duration
- 9.4 min
- Cost
- 2.63 USD billed
- Tokens
- 172.7k prompt · 1.28M completion · 1.46M total
moonshotai/kimi-k2
mean on this sampled test
· 0.106 USD billed
· 9.0k / 43.9k / 52.9k tok
· 19.9 s / question
65.6
qwen/qwen3.6-flash
mean on this sampled test
· 0.161 USD billed
· 10.2k / 141.4k / 151.5k tok
· 17.3 s / question
51.9
qwen/qwen3.7-flash
mean on this sampled test
· 0.020 USD billed
· 10.5k / 150.4k / 160.9k tok
· 24.0 s / question
51.1
qwen/qwen3.8-flash
mean on this sampled test
· 0.028 USD billed
· 13.1k / 55.1k / 68.2k tok
· 12.9 s / question
64.1
moonshotai/kimi-k2.5
mean on this sampled test
· 0.444 USD billed
· 9.0k / 190.9k / 199.9k tok
· 62.4 s / question
65.6
moonshotai/kimi-k2.6
mean on this sampled test
· 0.322 USD billed
· 8.8k / 97.8k / 106.7k tok
· 46.1 s / question
57.3
google/gemini-2.5-flash
mean on this sampled test
· 0.090 USD billed
· 8.5k / 34.9k / 43.4k tok
· 5.9 s / question
61.8
google/gemini-3.5-flash
mean on this sampled test
· 0.657 USD billed
· 8.2k / 71.6k / 79.8k tok
· 11.1 s / question
61.1
google/gemini-3.6-flash
mean on this sampled test
· 0.268 USD billed
· 8.4k / 69.8k / 78.2k tok
· 10.8 s / question
60.3
google/gemini-3.7-flash
mean on this sampled test
· 0.135 USD billed
· 8.4k / 34.2k / 42.6k tok
· 6.2 s / question
64.9
google/gemini-3.8-flash
mean on this sampled test
· 0.165 USD billed
· 8.6k / 42.3k / 50.9k tok
· 6.2 s / question
64.9
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.044 USD billed
· 10.5k / 167.8k / 178.3k tok
· 21.9 s / question
60.3
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0086 USD billed
· 9.7k / 29.2k / 38.8k tok
· 8.4 s / question
69.5
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.016 USD billed
· 9.4k / 38.2k / 47.7k tok
· 2.0 s / question
64.1
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.031 USD billed
· 9.0k / 18.9k / 27.9k tok
· 2.0 s / question
68.7
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.060 USD billed
· 8.7k / 23.1k / 31.7k tok
· 2.0 s / question
64.1
google/gemini-3-flash-preview
mean on this sampled test
· 0.062 USD billed
· 8.4k / 19.1k / 27.6k tok
· 4.0 s / question
69.5
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.013 USD billed
· 14.3k / 55.5k / 69.8k tok
· 8.9 s / question
67.2