74.8
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2008
- Model
- google/gemini-3-flash-preview
- Questions asked
- 101
- Seed
- 2008
- Fingerprint
- 21684f7019adad52bfd86d44
- When
- 2026-09-07T00:38:04.809777+00:00
- Duration
- 44.8 min
- Cost
- 2.86 USD billed
- Tokens
- 186.6k prompt · 1.38M completion · 1.57M total
moonshotai/kimi-k2
mean on this sampled test
· 0.124 USD billed
· 9.9k / 51.4k / 61.2k tok
· 13.0 s / question
70.2
qwen/qwen3.6-flash
mean on this sampled test
· 0.168 USD billed
· 11.0k / 147.2k / 158.2k tok
· 13.8 s / question
57.3
qwen/qwen3.7-flash
mean on this sampled test
· 0.022 USD billed
· 11.0k / 164.5k / 175.5k tok
· 23.4 s / question
54.2
qwen/qwen3.8-flash
mean on this sampled test
· 0.028 USD billed
· 13.5k / 55.9k / 69.4k tok
· 12.4 s / question
67.2
moonshotai/kimi-k2.5
mean on this sampled test
· 0.485 USD billed
· 10.0k / 207.7k / 217.6k tok
· 52.1 s / question
71.8
moonshotai/kimi-k2.6
mean on this sampled test
· 0.420 USD billed
· 9.8k / 132.8k / 142.7k tok
· 30.1 s / question
61.8
google/gemini-2.5-flash
mean on this sampled test
· 0.097 USD billed
· 9.3k / 37.6k / 46.9k tok
· 5.0 s / question
66.4
google/gemini-3.5-flash
mean on this sampled test
· 0.655 USD billed
· 9.2k / 71.2k / 80.4k tok
· 8.2 s / question
67.2
google/gemini-3.6-flash
mean on this sampled test
· 0.268 USD billed
· 9.2k / 69.6k / 78.8k tok
· 7.8 s / question
66.4
google/gemini-3.7-flash
mean on this sampled test
· 0.145 USD billed
· 9.4k / 36.9k / 46.3k tok
· 5.3 s / question
71.8
google/gemini-3.8-flash
mean on this sampled test
· 0.193 USD billed
· 9.4k / 49.5k / 59.0k tok
· 5.6 s / question
70.2
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.044 USD billed
· 11.0k / 166.8k / 177.8k tok
· 18.8 s / question
63.4
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0088 USD billed
· 10.4k / 28.7k / 39.0k tok
· 8.3 s / question
73.3
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.018 USD billed
· 9.8k / 43.5k / 53.3k tok
· 2.0 s / question
67.2
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.036 USD billed
· 9.7k / 22.1k / 31.8k tok
· 2.1 s / question
72.5
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.064 USD billed
· 9.4k / 24.3k / 33.8k tok
· 1.8 s / question
68.7
google/gemini-3-flash-preview
mean on this sampled test
· 0.070 USD billed
· 9.4k / 21.6k / 31.1k tok
· 3.5 s / question
74.8
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.012 USD billed
· 15.4k / 52.5k / 67.9k tok
· 4.5 s / question
71.8