Ring-Zero taught itself to reason from zero human examples

2 months ago

Give a trillion-parameter model nothing but right-or-wrong feedback on math. Never show it how to reason. It teaches itself anyway. And it learns to panic.

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Ring-Zero taught itself to reason from zero human examples
  2. 0:08No worked examples, just right or wrong
  3. 0:26Same recipe, bigger model, higher ceiling
  4. 0:43One climbing score, then two
  5. 1:28Competitive, in less than half the tokens
  6. 1:59What it invented on its own
  7. 2:42The paper, not the weights
  8. 2:54Nobody taught it to reason.
Show transcript

Ring-Zero taught itself to reason from zero human examples

1T total, 63B active; trained with zero-RL by inclusionAI (Ant Group).
inclusionAI · Ant Group 1T total / 63B active zero-RL paper · weights unreleased

Give a trillion-parameter model nothing but right-or-wrong feedback on math. Never show it how to reason. It teaches itself anyway. And it learns to panic.

No worked examples, just right or wrong

the usual recipe
base model
raw pretrained
→
human reasoning examples
thousands of worked solutions (SFT)
→
reinforcement learning
tune on rewards
zero-RL — what Ring-Zero does
base model
no SFT
→
human reasoning examples
shown none
removed
→
reward the answer only
+1 if final answer right, 0 if wrong
correctness is a deterministic rule match, with an LLM judge as fallback on the hardest answers · §4.1

It is called Ring-Zero. Normally you teach a model to reason with thousands of worked human solutions. Ring-Zero shows it none. You start from a raw base model and reward it only when its final answer is right. Instead of a teacher walking it through the work, it just hears back: right, or wrong.

Same recipe, bigger model, higher ceiling

100 75 50 25 0 AIME-2024 accuracy (%) 0 3,600 5,200 first-stage RL training steps →
89.06% 71.72% Ling-2.5-1T-Base · 1T total 104B flash · 10× smaller
the small model never crosses ~72%
first-stage RL, identical recipe · §5.1 / Fig 10a · curve readouts at 3,600 / 5,200 steps

Zero-RL was not new. Pushing it to a trillion parameters was. And the size is the point. On the same recipe, the trillion-parameter model hits eighty-nine percent on the 2024 olympiad set; a model ten times smaller stalls at seventy-two. You cannot prototype this cheaply on a small model; it never gets there.

One climbing score, then two

100 50 0 AIME-2024 accuracy (%) ~800 training steps →
the final score everyone watched new ability, or ability the base already had?
plateaus ~96.7% near ~800 steps pass@1024 · any of a thousand tries
discovery → sharpening still climbing pass@1 · first try
§5.2 · Fig 10b · the shape is text-stated; plateau values keep a ~ hedge (figure-read)

Here is the question the field was stuck on. When training makes a model reason better, is it teaching new ability, or just drilling what the base already had? Nobody could tell; they only watched the final score climb. So the authors watched two numbers. Give the model one hard problem. Let it try a thousand times, and ask if any single try lands. Then ask if its first try lands. Early on, the any-of-a-thousand number shoots up, then flattens near ninety-seven percent around eight hundred steps. But the first-try number climbs the whole run. The flattening means training stopped finding new problems the model can reach; that ability was there all along. The first-try number rising means it is getting reliable at landing the answer. So training does two things: first it discovers what the model can reach, then it sharpens it to hit that reliably.

Competitive, in less than half the tokens

AIME-2024 · best zero-RL checkpoints
peak row: Second Stage RL, Yarn=2 · 94.1 / 92.3 / 93.2 AIME 24/25/26
frontier, AIME-2026 (hardest set):
GPT-5.5 98.3 · Gemini 3.1 Pro 98.2 · each self-reported
94.1
Ring-Zero
peak checkpoint
77.9
DeepSeek R1-Zero
prior best zero-RL
Avg tokens per solved problem
mutually-solved AIME · all five systems correct · less than half
6,368
Ring-Zero
17,220
GLM-5.1
16,627
MiniMax-M2.7
16,292
Qwen3.5-397B
14,115
Kimi-K2.6

On the 2024 olympiad set, the best Ring-Zero checkpoint scores ninety-four; the best prior zero-trained model, DeepSeek's R1-Zero, scored seventy-eight. That sixteen-point jump is the scaling case. Against the frontier it is competitive, not ahead: on the hardest 2026 set it trails GPT-5.5 and Gemini 3.1 Pro, each grading its own model. It also runs cheap: on problems they all solve, it uses about six thousand tokens, less than half what GLM, MiniMax, Qwen and Kimi spend.

What it invented on its own

structure
numbers its own steps
parallel tries
runs an alternative approach, commits on convergence
self-check
substitutes its answer back to verify
borrowed forum phrasing
"brain fart" · "I'll wing it and go with 2" · "Genius Idea"
context anxiety flaw · degrades correctness
[near the token limit, it aborts the working and forces a guess]  "Given the time I've invested and the ambiguity, I will proceed to make an educated guess … Therefore, I'll conclude the answer is 20."
a wrong-format answer scores zero, a guess might not — so it learned to guess · authors' label, §6.4

Here is the part nobody built. Nothing rewarded how Ring-Zero reasoned, only its final answer. So the how, it invented. It numbers its own steps, runs rival approaches side by side, and checks its own answers. It even picked up forum phrasing: brain fart, I'll wing it and go with 2, Genius Idea. Then the one that backfires: context anxiety. As the answer nears the token limit, the model drops the careful work and forces a guess. One reads: given the time I've invested and the ambiguity, I will proceed to make an educated guess. I'll conclude the answer is 20. That is a flaw. It makes the model wrong more often. A wrong-format answer scores zero, a guess might not, so it learned to guess.

The paper, not the weights

arXiv 2607.12395
The full paper is up, from sixteen authors.
Ring-Zero model · weights unreleased
related open model: inclusionAI/Ring-2.5-1T (MIT) — a different, non-zero recipe, not the model in these results

The full paper is on arXiv, from sixteen authors. But the Ring-Zero model was not released. The lab open-sources a different Ring model, on a different recipe. This result lives on paper, not as a download.

Nobody taught it to reason.

so everything it does to reason, it found on its own
Every win here is on math, where a right answer is cheap to grade. The open question: does this still hold where you cannot grade the answer so cleanly — in writing, code, judgment? That is what tells us how far "just reward the answer" can go. arXiv 2607.12395

Nobody taught this model to reason. So everything it does to reason, it found on its own, the panic included. And every win here is on math, where a right answer is cheap to grade. The open question: does this still work where you cannot grade the answer so cleanly, in writing, code, judgment? That is what tells us how far just reward the answer can go.

Up next

2:58

Apodex 1.1 mini · the same file, run alone and run as a team

@ai-ml-today · 1 month ago

3:09

Ornith-1.5 · an open model trained on problems it wrote for itself

@ai-ml-today · 1 month ago

3:08

MOSS-VL · an open 11B video model trained to decide, after every frame, whether to speak or stay silent

@ai-ml-today · 1 month ago

3:29

Qwen3.8-27B · a 27B open model anyone can download averages 84.3 across real desktop jobs on Qwen’s own run, and loses the widest row on its own card by nine points

@ai-ml-today · 1 month ago

3:15

MiLMMT-46-v1.0 · Xiaomi finished training an open translator on sentences that had no translation attached, and the scores it now leads on are produced by the two models that graded it

@ai-ml-today · 1 month ago

3:31

BDH-CQ — a 150M-parameter system that learns a puzzle rule from the worked examples in front of it and does its thinking as numbers, never as words

@ai-ml-today · 2 months ago

3:29

Muse Glimmer 30B, Meta’s open agent model, and the second tiny model that guesses sixteen words ahead so it runs fast on one consumer graphics card

@ai-ml-today · 2 months ago

3:05

JoyAI-Video-Edit, JD’s open 16B model that edits a video while the video is still playing, at about 30 frames a second on one Nvidia B200

@ai-ml-today · 2 months ago

3:26

Inkling-Small, Thinking Machines’ 12B-active / 276B open mixture-of-experts model that out-reasons its own 3.5× bigger flagship

@ai-ml-today · 2 months ago

3:42

Maple-Preview, DeepGrove’s 20-billion-parameter ternary reasoning model that runs on a Mac mini

@ai-ml-today · 2 months ago

3:16

Hunyuan3D-Buffalo, Tencent’s one model that builds, understands, and edits 3D from words

@ai-ml-today · 2 months ago

3:28

MiniMax H3, an open model that makes a video and its soundtrack in one pass

@ai-ml-today · 2 months ago