70.2
The large value shows the leading mean for this attempt. Rankings are calculated across repeated attempts rather than from this result alone.
- Attempt
- flash-2024
- Model
- google/gemini-3-flash-preview
- Questions asked
- 101
- Seed
- 2024
- Fingerprint
- 7f59ca60cd509e1861cb6f73
- When
- 2026-09-07T05:45:17.387168+00:00
- Duration
- 157 ms
- Cost
- 2.79 USD billed
- Tokens
- 165.8k prompt · 1.30M completion · 1.47M total
moonshotai/kimi-k2
mean on this sampled test
· 0.115 USD billed
· 8.9k / 47.9k / 56.7k tok
· 17.0 s / question
64.9
qwen/qwen3.6-flash
mean on this sampled test
· 0.160 USD billed
· 9.7k / 140.5k / 150.2k tok
· 19.2 s / question
51.1
qwen/qwen3.7-flash
mean on this sampled test
· 0.020 USD billed
· 9.8k / 149.6k / 159.4k tok
· 29.1 s / question
48.9
qwen/qwen3.8-flash
mean on this sampled test
· 0.028 USD billed
· 11.8k / 56.8k / 68.6k tok
· 34.7 s / question
59.5
moonshotai/kimi-k2.5
mean on this sampled test
· 0.476 USD billed
· 8.8k / 199.0k / 207.8k tok
· 62.4 s / question
64.9
moonshotai/kimi-k2.6
mean on this sampled test
· 0.402 USD billed
· 8.8k / 118.1k / 126.9k tok
· 48.9 s / question
58.0
google/gemini-2.5-flash
mean on this sampled test
· 0.091 USD billed
· 8.3k / 35.5k / 43.8k tok
· 4.7 s / question
61.8
google/gemini-3.5-flash
mean on this sampled test
· 0.675 USD billed
· 8.2k / 73.6k / 81.8k tok
· 11.1 s / question
61.1
google/gemini-3.6-flash
mean on this sampled test
· 0.283 USD billed
· 8.2k / 73.9k / 82.0k tok
· 10.2 s / question
61.1
google/gemini-3.7-flash
mean on this sampled test
· 0.139 USD billed
· 8.2k / 35.5k / 43.7k tok
· 5.9 s / question
64.1
google/gemini-3.8-flash
mean on this sampled test
· 0.178 USD billed
· 8.2k / 45.7k / 53.9k tok
· 6.2 s / question
64.1
qwen/qwen3.5-flash-02-23
mean on this sampled test
· 0.040 USD billed
· 9.8k / 152.4k / 162.2k tok
· 21.0 s / question
59.5
deepseek/deepseek-v4-flash
mean on this sampled test
· 0.0083 USD billed
· 9.3k / 27.2k / 36.5k tok
· 9.1 s / question
66.4
google/gemini-2.5-flash-lite
mean on this sampled test
· 0.014 USD billed
· 8.7k / 32.1k / 40.9k tok
· 2.0 s / question
61.1
google/gemini-3.1-flash-lite
mean on this sampled test
· 0.029 USD billed
· 8.6k / 18.2k / 26.8k tok
· 2.0 s / question
67.9
google/gemini-3.5-flash-lite
mean on this sampled test
· 0.058 USD billed
· 8.3k / 22.2k / 30.5k tok
· 2.0 s / question
62.6
google/gemini-3-flash-preview
mean on this sampled test
· 0.063 USD billed
· 8.3k / 19.5k / 27.8k tok
· 3.8 s / question
70.2
deepseek/deepseek-v4-flash-0731
mean on this sampled test
· 0.013 USD billed
· 13.8k / 54.5k / 68.3k tok
· 8.1 s / question
66.4