74.8
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2020
- Model
- google/gemini-3-flash-preview
- Questions asked
- 101
- Seed
- 2020
- Fingerprint
- 18160b46bc54b0ca9cc9b11a
- When
- 2026-09-07T04:34:22.905729+00:00
- Duration
- 7.3 min
- Cost
- 2.78 USD billed
- Tokens
- 183.9k prompt · 1.34M completion · 1.53M total
moonshotai/kimi-k2
mean on this sampled test
· 0.122 USD billed
· 9.8k / 50.7k / 60.5k tok
· 12.9 s / question
69.5
qwen/qwen3.6-flash
mean on this sampled test
· 0.164 USD billed
· 10.6k / 143.8k / 154.4k tok
· 15.2 s / question
56.5
qwen/qwen3.7-flash
mean on this sampled test
· 0.020 USD billed
· 10.9k / 154.6k / 165.5k tok
· 23.4 s / question
55.7
qwen/qwen3.8-flash
mean on this sampled test
· 0.030 USD billed
· 13.6k / 59.1k / 72.8k tok
· 9.6 s / question
67.2
moonshotai/kimi-k2.5
mean on this sampled test
· 0.438 USD billed
· 9.7k / 186.0k / 195.8k tok
· 57.4 s / question
69.5
moonshotai/kimi-k2.6
mean on this sampled test
· 0.371 USD billed
· 9.7k / 110.4k / 120.1k tok
· 37.3 s / question
62.6
google/gemini-2.5-flash
mean on this sampled test
· 0.092 USD billed
· 9.2k / 35.9k / 45.1k tok
· 4.7 s / question
65.6
google/gemini-3.5-flash
mean on this sampled test
· 0.687 USD billed
· 9.1k / 74.8k / 83.9k tok
· 8.3 s / question
66.4
google/gemini-3.6-flash
mean on this sampled test
· 0.283 USD billed
· 9.1k / 73.7k / 82.8k tok
· 9.7 s / question
65.6
google/gemini-3.7-flash
mean on this sampled test
· 0.146 USD billed
· 9.1k / 37.2k / 46.3k tok
· 5.6 s / question
69.5
google/gemini-3.8-flash
mean on this sampled test
· 0.189 USD billed
· 9.1k / 48.6k / 57.6k tok
· 5.6 s / question
69.5
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.047 USD billed
· 10.9k / 178.5k / 189.4k tok
· 20.9 s / question
63.4
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0093 USD billed
· 10.7k / 29.8k / 40.5k tok
· 7.1 s / question
72.5
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.019 USD billed
· 9.8k / 44.0k / 53.8k tok
· 1.9 s / question
65.6
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.031 USD billed
· 9.3k / 19.4k / 28.7k tok
· 2.1 s / question
71.8
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.058 USD billed
· 9.2k / 22.1k / 31.3k tok
· 1.8 s / question
66.4
google/gemini-3-flash-preview
mean on this sampled test
· 0.065 USD billed
· 9.2k / 20.1k / 29.3k tok
· 3.8 s / question
74.8
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.012 USD billed
· 14.8k / 55.5k / 70.3k tok
· 6.0 s / question
68.7