Inkling-Small, Thinking Machines’ 12B-active / 276B open mixture-of-experts model that out-reasons its own 3.5× bigger flagship

2 months ago

Thinking Machines just released a new AI model that out-reasons another of its own models about three and a half times the size. The smaller, newer one is called Inkling-Small, and its weights are open, free to download and run.

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Inkling-Small
  2. 0:12276 billion parameters. About 12 billion fire per word.
  3. 0:38The smaller sibling wins the hard rows
  4. 1:13Total is the library. Active is the thinking.
  5. 1:48Cut the library, keep the thinking
  6. 2:17Wins reasoning, loses recall, overall a wash
  7. 2:50Open weights, Apache 2.0, on Hugging Face
  8. 3:06Size is two numbers. The reasoning is in the small one.
Show transcript

Inkling-Small

A third the size of its own flagship. It out-reasons it.
Thinking Machines Apache-2.0 · ungated text + image + audio in 276B total · 12B active 1M context

Thinking Machines just released a new AI model that out-reasons another of its own models about three and a half times the size. The smaller, newer one is called Inkling-Small, and its weights are open, free to download and run.

276 billion parameters. About 12 billion fire per word.

licenseApache-2.0, ungated
size276B total · 12B active per word
inputtext + image + audio
context1M tokens
buildsfull precision ≈532 GB · 4-bit ≈171 GB4-bit pulled ≈4× more
Thinking Machines, Inkling-Small model card, config.json, and the Hugging Face API.

Inkling-Small is a mixture-of-experts model. That means it is built from hundreds of small specialist networks. For each word, it wakes only a few of them. So it holds two hundred and seventy-six billion parameters in total, but only about twelve billion do the work on any given word. It reads text, images, and audio, up to about a million words at once. And the four-bit version, the compressed build most people are downloading, is getting pulled about four times as often as the full one.

The smaller sibling wins the hard rows

Both Inkling models · Thinking Machines’ own eval · same in-house harness · effort 0.99, temp 1.0.
SWE-bench Verified· fixing real GitHub bugs
Inkling-Small80.2
Inkling flagship77.6
Terminal Bench 2.1· a command-line coding test≈ tie
Inkling-Small64.7
Inkling flagship63.8
GPQA Diamond· graduate-level science
Inkling-Small89.5
Inkling flagship87.2
HMMT Feb 2026· competition math
Inkling-Small90.2
Inkling flagship86.3
Independent · Artificial Analysis found the same: Inkling-Small meeting or beating the flagship on coding and reasoning.
Thinking Machines, Inkling-Small model card benchmark table (Hugging Face).

On Thinking Machines’ own benchmarks, run the same way for both models, the smaller Inkling-Small matches or beats the bigger flagship on nearly every reasoning, math, and coding test. On SWE-bench Verified, which scores a model on fixing real, filed GitHub bugs, Inkling-Small gets eighty point two against the flagship’s seventy-seven point six. A second coding test comes out about even. On graduate-level science questions, Inkling-Small scores eighty-nine point five against eighty-seven point two, and it leads on hard competition math as well. An independent evaluation from Artificial Analysis found the same: the small model meeting or beating the flagship on coding and reasoning.

Total is the library. Active is the thinking.

6 fire per word 2 shared, always on
≈12B of 276B active per word
total = memory · 276B
active = thinking per word · ≈12B
Thinking Machines, Inkling-Small config.json (Hugging Face).

So why can the smaller model think just as well? Because in a model like this, size is really two numbers. Inkling-Small holds two hundred and fifty-six of those specialist networks, and for each word it switches on just six of them, plus two that are always running. So out of two hundred and seventy-six billion parameters, only about twelve billion fire on any word. The big number, the total, is the model’s library: how much it can store. The small number, the active one, is how much thinking it does per word. A bigger library lets a model remember more. By itself, it does not make the model think any harder.

Cut the library, keep the thinking

same recipe · two sizes
Inkling flagship41B active per word
975B total
Inkling-Small12B active per word
276B total
reasoning held ✓ recall dropped ✗ → the number lands on the next slide
Thinking Machines, Inkling and Inkling-Small config.json (Hugging Face).

Here is what makes this a clean test. The two Inkling models are the same design, just built at two sizes. Thinking Machines cut both numbers to about a third. The flagship runs forty-one billion active parameters; Inkling-Small runs twelve. And its reasoning held, or got better. One thing did get clearly worse. The smaller model remembers fewer plain facts, and you will see that number on the next slide. A smaller library stores less. So the flagship’s extra size bought mostly memory. The thinking barely changed.

Wins reasoning, loses recall, overall a wash

SWE-bench Verified
fixing real GitHub bugs
Inkling-Small80.2
Inkling flagship77.6
Inkling-Small wins the hard row
SimpleQA Verified
short, look-it-up factual questions
Inkling-Small20.6
Inkling flagship43.9
the flagship remembers more than twice as much
Blended across dozens of tests: basically evenArtificial Analysis · Intelligence Index
Thinking Machines, Inkling-Small model card benchmark table (Hugging Face).

Here is the whole picture on one panel. On SWE-bench Verified, fixing real GitHub bugs, Inkling-Small wins, eighty point two to seventy-seven point six. But on SimpleQA Verified, which asks short, look-it-up factual questions, the flagship wins big, forty-three point nine to Inkling-Small’s twenty point six. The flagship gets more than twice as many right. That is the tell: a smaller library remembers fewer facts. Then Artificial Analysis blends dozens of these tests into one score. On that blend, the two models come out basically even.

Open weights, Apache 2.0, on Hugging Face

weightshuggingface.co/thinkingmachines/Inkling-Small
buildsfull precision ≈532 GB · 4-bit ≈171 GB
runs onSGLang, vLLM, Hugging Face
Apache-2.0 · ungated
Thinking Machines, Inkling-Small (Hugging Face) · release state re-checked 2026-08-08.

You can download it today. The weights are on Hugging Face under Apache two point oh, a fully open license with no gate, so anyone can run it. The full-precision build is about five hundred and thirty gigabytes. The four-bit one is about a hundred and seventy.

Size is two numbers. The reasoning is in the small one.

total = memory · active = thinking · they cut the memory, kept the thinking
Thinking Machines Apache-2.0 · open weights huggingface.co/thinkingmachines/Inkling-Small

So, is a bigger AI a smarter AI? Not by itself. Inkling-Small shows that a model’s size is really two numbers: a big one for how much it can remember, and a small one for how much it thinks per word. Thinking Machines shrank the memory and kept the thinking. The smaller model did the harder reasoning, and the extra size just bought more facts.

Up next

2:58

Apodex 1.1 mini · the same file, run alone and run as a team

@ai-ml-today · 1 month ago

3:09

Ornith-1.5 · an open model trained on problems it wrote for itself

@ai-ml-today · 1 month ago

3:08

MOSS-VL · an open 11B video model trained to decide, after every frame, whether to speak or stay silent

@ai-ml-today · 1 month ago

3:29

Qwen3.8-27B · a 27B open model anyone can download averages 84.3 across real desktop jobs on Qwen’s own run, and loses the widest row on its own card by nine points

@ai-ml-today · 1 month ago

3:15

MiLMMT-46-v1.0 · Xiaomi finished training an open translator on sentences that had no translation attached, and the scores it now leads on are produced by the two models that graded it

@ai-ml-today · 1 month ago

3:31

BDH-CQ — a 150M-parameter system that learns a puzzle rule from the worked examples in front of it and does its thinking as numbers, never as words

@ai-ml-today · 2 months ago

3:29

Muse Glimmer 30B, Meta’s open agent model, and the second tiny model that guesses sixteen words ahead so it runs fast on one consumer graphics card

@ai-ml-today · 2 months ago

3:05

JoyAI-Video-Edit, JD’s open 16B model that edits a video while the video is still playing, at about 30 frames a second on one Nvidia B200

@ai-ml-today · 2 months ago

3:42

Maple-Preview, DeepGrove’s 20-billion-parameter ternary reasoning model that runs on a Mac mini

@ai-ml-today · 2 months ago

3:16

Hunyuan3D-Buffalo, Tencent’s one model that builds, understands, and edits 3D from words

@ai-ml-today · 2 months ago

3:28

MiniMax H3, an open model that makes a video and its soundtrack in one pass

@ai-ml-today · 2 months ago

3:37

DiffusionGemma, Google’s open model that writes text a whole block at a time

@ai-ml-today · 2 months ago