Ollama run now answers yes-or-no questions with decision models

1 hour ago

Ollama v0.40.3 and v0.40.4 (October 11 and 12, 2026): ollama run now works with decision models like Nimble, answering yes-or-no questions, picking labels and scoring levels. Kev decision models run on Apple silicon, background model upgrades are paused, repeat embedding requests answer in about half the time, and ollama launch lists your local models in Codex. https://github.com/ollama/ollama/releases/tag/v0.40.4 https://github.com/ollama/ollama/releases/tag/v0.40.3 https://github.com/ollama/ollama/compare/v0.40.2...v0.40.4

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Ollama run now answers yes-or-no questions with decision models
  2. 0:14The same question can pick a label or score a level
  3. 0:28Kev decision models run on Apple silicon
  4. 0:39Background model upgrades are paused
  5. 0:52Repeat embedding requests answer in about half the time
  6. 1:06ollama launch works with more of your models and plans
  7. 1:20Gemma 4 and image embeddings get faster and steadier
Show transcript

Ollama run now answers yes-or-no questions with decision models

Ollama
Ollama
October 2026
Ollama
ollama run answers yes-or-no questions with decision models
$ ollama run nimble --ask "Is a refund being requested?" < ticket.txt
Is a refund being requested?    yes   97%
Ollama release notes, Oct 12 2026 · Decision models in the CLI · PR #18962

Ollama run now works with decision models like Nimble, where before it failed outright. Pipe in a support ticket, ask whether a refund is being requested, and it answers yes, with how sure it is.

The same question can pick a label or score a level

Ollama
Ollama
October 2026

One run can also pick a label or score a level

Is a refund being requested?    yes      97%
Which team should handle this?  billing  91%
How urgent is this?             Soon     64%  1.2 / 2
PR #18962

A question can also choose between labels you name, like billing or technical, or score the text on levels, from routine to immediate. Several questions fit in one run, and each answer prints on its own line.

Kev decision models run on Apple silicon

Ollama
Ollama
October 2026
Ollama’s MLX runner now scores with Kev, and the bundled llama.cpp handles decision models natively.
Ollama release notes, Oct 12 2026 · PR #18976

On a Mac with Apple silicon, Kev decision models now run on Ollama's MLX runner. And the llama.cpp inside Ollama now supports decision models natively.

Background model upgrades are paused

Ollama
Ollama
October 2026
Models from older versions run as they are, until a future release.
Ollama release notes, Oct 11 2026 · PR #18908

Ollama has paused its background upgrade of models you downloaded with older versions. It added work to every request and slowed heavy embedding workloads. A future release brings it back.

Repeat embedding requests answer in about half the time

Ollama
Ollama
October 2026
Before
17.0 ms
Now
7.5 ms
PR #18947 · warm requests, embeddinggemma-2 on MLX

When a model is already loaded, Ollama now reuses it instead of looking it up again. A repeat embedding request to Embedding Gemma 2 drops from seventeen milliseconds to about seven and a half.

ollama launch works with more of your models and plans

Ollama
Ollama
October 2026

ollama launch opens up

  • Codex lists your installed Ollama models in /model
  • Usage credits work without upgrading to a paid plan
  • Claude Code and Codex start without warnings
PR #18887 · PR #18985 · PR #18878 · PR #18879

Ollama launch Codex now puts your installed local models in Codex's model picker. Launch also works with usage credits without a paid plan, and Claude Code and Codex start without warnings.

Gemma 4 and image embeddings get faster and steadier

Ollama
Ollama
October 2026

Gemma 4 and image embeddings

  • Gemma 4 reads prompts 2 to 4× faster on NVIDIA with the MLX runner
  • Multimodal embeddings run through llama-server
  • Image embedding models load with a small context window
Ollama release notes, Oct 12 2026 · PR #18809 · PR #18973

With the MLX runner on NVIDIA, Gemma 4 reads prompts two to four times faster. Image embedding models now run through llama server, and load even with a small context window. The full list is in Ollama's release notes on GitHub.