Ollama runs Perplexity's pplx-decider, a local 27B model that routes, checks and grades

1 hour ago

Ollama v0.40.6 and v0.40.7 (October 16 to 18, 2026) add pplx-decider, a 27B decision model from Perplexity that returns a probability for every answer instead of writing text: route a request, check a condition, or grade an answer. Ollama also loads Prism ML's Bonsai 2 models in their 2-bit Q2_0 files, fixes Codex and other OpenAI Responses clients, and cancels cloud requests on ollama.com when your client disconnects. https://github.com/ollama/ollama/releases/tag/v0.40.7 https://github.com/ollama/ollama/releases/tag/v0.40.6 https://github.com/ollama/ollama/compare/v0.40.5...v0.40.7 https://ollama.com/library/pplx-decider

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Ollama runs Perplexity's pplx-decider, a local 27B model that routes, checks and grades
  2. 0:17pplx-decider returns a probability for every answer, with no text generated
  3. 0:30pplx-decider is more accurate than Jev and its own Qwen base
  4. 0:41Prism ML's Bonsai 2 models load from their 2-bit files
  5. 0:58Codex conversations on Ollama's Responses API stop failing
  6. 1:13Cancelling a cloud request now stops it on ollama.com
  7. 1:24Windows runners, proxy pulls and draft models
  8. 1:37Which question would you hand pplx-decider first?
Show transcript

Ollama runs Perplexity's pplx-decider, a local 27B model that routes, checks and grades

Ollama
Ollama
October 2026
Ollama
Ollama runs Perplexity’s pplx-decider, a local 27B model that routes, checks and grades
$ ollama run pplx-decider --ask "Is a refund being requested?" < ticket.txt
27Bparameters
17 GBdownload
256Kcontext
Text, imageinput
Ollama release notes, Oct 17 2026 · PR #19072 · ollama.com/library/pplx-decider

Ollama now runs pplx-decider, a 27 billion parameter decision model from Perplexity, fine-tuned from Qwen 3.8. Hand it a support ticket, a screenshot or a form, ask a question in plain words, and it decides.

pplx-decider returns a probability for every answer, with no text generated

Ollama
Ollama
October 2026
$ ollama run pplx-decider --ask "Which team should handle this?" \
    --choice billing="Payments and refunds" \
    --choice technical="Outages and errors" < ticket.txt
  • Choice picks a destination for a request
  • Yes or no checks a condition, or gates an agent step
  • Score grades an answer against a rubric
ollama.com/library/pplx-decider · PR #19072

pplx-decider never writes a reply. It scores every option of every question in one pass. So it can route a ticket to billing, check a yes or no condition, or grade an answer.

pplx-decider is more accurate than Jev and its own Qwen base

Ollama
Ollama
October 2026
pplx-decider
85.7%
Jev
84.5%
Qwen3.8-27B base
74.8%
Accuracy across 11 public benchmarks
ollama.com/library/pplx-decider · Perplexity’s evaluation, 11 public benchmarks

Across eleven public benchmarks, pplx-decider edges out the Jev decision model, and gets about one more answer in ten right than the Qwen model it was trained from.

Prism ML's Bonsai 2 models load from their 2-bit files

Ollama
Ollama
October 2026

Prism ML’s Bonsai 2 models load from their 2-bit files

unsupported tensor "token_embd.weight" size overflows
2BBonsai 2
4BBonsai 2
9BBonsai 2
27BBonsai 2
Ollama release notes, Oct 16 2026 · PR #18967

Ollama now reads the two-bit Q2_0 format. Those files used to stop with a size overflow error, at create time and at load. That unblocks Prism ML's Bonsai 2 models, from 2 billion to 27 billion parameters.

Codex conversations on Ollama's Responses API stop failing

Ollama
Ollama
October 2026

Codex conversations on Ollama’s Responses API stop failing

  • Switching models between thinking and non-thinking mid-conversation
  • Another provider’s compaction items in the history
  • Streamed tool calls arrive after reasoning, with web search on
Ollama release notes, Oct 17 2026 · PR #19010 · PR #19003 · PR #19146

Codex and other OpenAI Responses clients get three fixes. A conversation can switch between thinking and non-thinking models, carry another provider's compacted history, and stream tool calls without duplicates.

Cancelling a cloud request now stops it on ollama.com

Ollama
Ollama
October 2026
Beforeclient disconnects, model keeps running
Nowrequest is cancelled upstream
Ollama release notes, Oct 17 2026 · PR #19144

When your client disconnects from a request to a cloud model, Ollama now cancels it on ollama.com. Before, the remote model kept generating after you had walked away.

Windows runners, proxy pulls and draft models

Ollama
Ollama
October 2026
  • Windows: killing ollama serve in a terminal also ends its llama-server and MLX runners
  • Proxies: model pulls follow registry redirects through your proxy
  • Speculative decoding: llama-server detects more draft models on its own
PR #18500 · PR #19065 · Ollama release notes, Oct 17 2026 · PR #19064

On Windows, killing ollama serve now takes its llama server and MLX runners with it, instead of leaving them running. Pulls work behind a proxy, and more draft models work for speculative decoding.

Which question would you hand pplx-decider first?

Ollama
Ollama
October 2026
Ollama release notes on GitHubgithub.com/ollama/ollama/releases
github.com/ollama/ollama/releases

The full list is in Ollama's release notes on GitHub. Which question would you hand pplx-decider first?