Ollama v0.40.8 runs Flint, Recursive's open coding model for agents, on Macs first

2 hours ago

Ollama v0.40.8 runs Flint, Recursive's 40B mixture-of-experts coding model for agents, with about 2.5B parameters active per token and a 262K-token context window. It runs on macOS through Ollama's MLX engine today; other GPUs get it in a later release. https://github.com/ollama/ollama/releases/tag/v0.40.8 https://github.com/ollama/ollama/compare/v0.40.7...v0.40.8 https://ollama.com/library/flint https://huggingface.co/RecursiveSI/flint

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Ollama v0.40.8 runs Flint, Recursive's open coding model for agents, on Macs first
  2. 0:13Flint runs on macOS now, and other GPUs get it in a later release
  3. 0:28Flint has 40B parameters and puts about 2.5B to work on each token
  4. 0:42Flint holds 262K tokens for tasks that run across many files
  5. 0:56Flint fixes about three in four real GitHub issues on SWE-bench Verified
  6. 1:08Which coding agent would you run Flint in?
Show transcript

Ollama v0.40.8 runs Flint, Recursive's open coding model for agents, on Macs first

Ollama
Ollama
v0.40.8
Flint
Ollama v0.40.8 runs Flint, Recursive’s open coding model for agents, on Macs first
$ ollama run flint
Ollama v0.40.8 release notes · github.com/ollama/ollama/releases/tag/v0.40.8

Ollama now runs Flint, the coding model from Recursive. It is built for the work coding agents do inside a repository: reading unfamiliar code, tracing bugs, adding features and writing tests.

Flint runs on macOS now, and other GPUs get it in a later release

Ollama
Ollama
v0.40.8
macOSsupported in v0.40.8
Other GPUsa subsequent release
Ollama v0.40.8 release notes · commit “mlx: add Flint model support” (#19181)

Flint runs on Ollama's MLX engine, so this release supports it on macOS. Support for other GPUs comes in a later release. If your Ollama machine runs on another GPU, Flint has to wait.

Flint has 40B parameters and puts about 2.5B to work on each token

Ollama
Ollama
v0.40.8
40Bparameters, mixture of experts
~2.5Bactive per token
23 GBdefault download
Apache 2.0license
Ollama v0.40.8 release notes · ollama.com/library/flint/tags

Flint is a mixture of experts with 40 billion parameters, and only about two and a half billion of them work on each token. The default download is 23 gigabytes, under the Apache 2.0 license.

Flint holds 262K tokens for tasks that run across many files

Ollama
Ollama
v0.40.8
  • Reasoning before it answers
  • Multi-turn tool use inside an agent loop
  • 262K-token context window
Ollama v0.40.8 release notes

Flint reasons before it answers, calls tools over many turns, and holds a context window of about 260 thousand tokens. That leaves room for a long task that moves across files and tool calls.

Flint fixes about three in four real GitHub issues on SWE-bench Verified

Ollama
Ollama
v0.40.8
SWE-bench Verified · real GitHub issues
74.2%
Terminal-Bench 2.1 · tasks in a shell
54.9%
Ollama v0.40.8 release notes · huggingface.co/RecursiveSI/flint

Given real bug reports from open source Python projects, Flint writes a working fix for about three in four. At a command line, it finishes just over half of the jobs it gets.

Which coding agent would you run Flint in?

Ollama
Ollama
v0.40.8
Ollama v0.40.8 release notes on GitHubgithub.com/ollama/ollama/releases
github.com/ollama/ollama/releases/tag/v0.40.8

On a Mac, Flint is one pull away. Which coding agent would you run it in?