ISOTANTA
ink
field

seed 42

SEALED · STRATIFIED

The current draw

The sampled questions remain private while models are evaluated under common conditions. Rankings are based on repeated public attempts rather than a single result.

Questions held
1,661
Hard set (god-mode)
421
Asked this time
132
Not asked (held out)
289
Seed
42
Fingerprint
63700c2cd78d6d2cf1308dac
Public attempts
192

claude-fable-5

median 98.0 · 35 attempts

98.0

grok-4.6

median 97.6 · 58 attempts

97.6

gpt-5.6-sol

median 97.5 · 30 attempts

97.5

claude-fable-5.1

median 96.9 · 10 attempts

96.9

claude-opus-4.7

median 96.4 · 5 attempts

96.4

gpt-5.6-terra

median 96.4 · 5 attempts

96.4

gpt-6-astra

median 96.3 · 10 attempts

96.3

gpt-5.6-luna-pro

median 96.2 · 5 attempts

96.2

gpt-5.6-sol-pro

median 96.0 · 5 attempts

96.0

grok-4.5

median 95.2 · 5 attempts

95.2

claude-sonnet-4.6

median 95.0 · 11 attempts

95.0

grok-4.7

median 94.7 · 11 attempts

94.7

grok-4.3

median 94.7 · 5 attempts

94.7

claude-opus-4.8

median 94.6 · 5 attempts

94.6

gpt-5.6-terra-pro

median 94.3 · 5 attempts

94.3

gpt-4.1-mini

median 94.2 · 5 attempts

94.2

gpt-5.6-luna

median 94.2 · 5 attempts

94.2

claude-opus-5.5

median 94.0 · 16 attempts

94.0

gpt-5.5

median 94.0 · 5 attempts

94.0

claude-sonnet-5.5

median 93.9 · 10 attempts

93.9

claude-sonnet-5

median 93.8 · 5 attempts

93.8

claude-sonnet-4

median 93.6 · 5 attempts

93.6

gpt-6-astra-pro

median 93.2 · 5 attempts

93.2

o4-mini

median 92.9 · 11 attempts

92.9

kimi-k3

median 92.8 · 38 attempts

92.8

qwen3.7-plus

median 91.6 · 5 attempts

91.6

qwen3.7-max

median 91.4 · 5 attempts

91.4

gpt-5.4

median 90.7 · 11 attempts

90.7

gpt-6.1-sol

median 88.6 · 10 attempts

88.6

gpt-6-luna-pro

median 88.5 · 10 attempts

88.5

ember-1

median 88.2 · 10 attempts

88.2

gpt-6-sol

median 88.2 · 10 attempts

88.2

qwen3-max

median 87.9 · 11 attempts

87.9

inkling

median 87.5 · 30 attempts

87.5

gpt-6-sol-pro

median 87.5 · 10 attempts

87.5

glm-5.3-flash

median 87.4 · 35 attempts

87.4

gemini-4-argon

median 87.3 · 5 attempts

87.3

claude-haiku-5.5

median 86.7 · 5 attempts

86.7

gpt-5.4-nano

median 86.7 · 5 attempts

86.7

mistral-medium-3.1

median 86.6 · 30 attempts

86.6

gpt-6.1-sol-pro

median 86.5 · 10 attempts

86.5

deepseek-v4-pro

median 85.7 · 5 attempts

85.7

command-a

median 85.1 · 30 attempts

85.1

claude-opus-5

median 85.1 · 15 attempts

85.1

grok-4.20

median 84.9 · 10 attempts

84.9

gpt-6-luna

median 84.8 · 10 attempts

84.8

gpt-4.1

median 84.5 · 5 attempts

84.5

mistral-large-4-0

median 84.3 · 10 attempts

84.3

devstral-2512

median 83.6 · 30 attempts

83.6

inkling-small

median 82.1 · 30 attempts

82.1

gpt-5.5-pro

median 80.9 · 5 attempts

80.9

glm-5.3

median 80.7 · 38 attempts

80.7

codestral-2508

median 79.5 · 30 attempts

79.5

llama-4-maverick

median 79.4 · 30 attempts

79.4

mimo-v2.6-pro

median 79.1 · 10 attempts

79.1

deepseek-v4-pro-0813

median 77.7 · 8 attempts

77.7

mistral-medium-3-5

median 77.5 · 10 attempts

77.5

mimo-v2.5-pro

median 77.1 · 5 attempts

77.1

deepseek-v4.1-flash

median 76.9 · 5 attempts

76.9

llama-3.3-70b-instruct

median 76.2 · 5 attempts

76.2

deepseek-r1-0528

median 73.6 · 11 attempts

73.6

gemini-3-flash-preview

median 73.3 · 30 attempts

73.3

mimo-v2.6-flash

median 73.2 · 10 attempts

73.2

deepseek-v4-flash

median 72.5 · 30 attempts

72.5

mimo-v2.5

median 71.6 · 5 attempts

71.6

gemini-2.5-pro

median 71.4 · 11 attempts

71.4

gemini-3.1-flash-lite

median 70.6 · 30 attempts

70.6

deepseek-v4-flash-0731

median 70.2 · 30 attempts

70.2

qwen3.8-2.4t-a95b

median 70.2 · 5 attempts

70.2

muse-spark-1.3

median 70.1 · 6 attempts

70.1

gemini-3.7-flash

median 69.8 · 30 attempts

69.8

gemini-3.8-flash

median 69.5 · 31 attempts

69.5

kimi-k2

median 69.5 · 30 attempts

69.5

kimi-k2.5

median 69.5 · 30 attempts

69.5

gemini-3.5-flash-lite

median 66.4 · 30 attempts

66.4

gemini-2.5-flash

median 65.6 · 30 attempts

65.6

gemini-2.5-flash-lite

median 65.6 · 30 attempts

65.6

gemini-3.5-flash

median 65.6 · 30 attempts

65.6

qwen3.8-flash

median 65.2 · 30 attempts

65.2

gemini-3.6-flash

median 64.5 · 30 attempts

64.5

qwen3.5-flash-02-23

median 63.8 · 30 attempts

63.8

kimi-k2.6

median 61.8 · 30 attempts

61.8

muse-wonder

median 58.3 · 5 attempts

58.3

gemini-3.1-pro-preview

median 58.0 · 35 attempts

58.0

mimo-v2.6-pro-ultraspeed

median 56.4 · 10 attempts

56.4

qwen3.6-flash

median 55.7 · 30 attempts

55.7

qwen3.7-flash

median 54.6 · 30 attempts

54.6

qwen3.8-max-0902

median 54.4 · 13 attempts

54.4

muse-glimmer-30b

median 51.8 · 10 attempts

51.8

command-a-plus

median 50.8 · 10 attempts

50.8

qwen3.8-max-prime

median 50.5 · 10 attempts

50.5

glm-5.3-prime

median 46.4 · 15 attempts

46.4

qwen3.8-27b

median 45.8 · 5 attempts

45.8

mistral-small-2603

median 27.1 · 30 attempts

27.1

nova-premier-v1

median 2.0 · 30 attempts

2.0