Run a real LLM on your desk, starting at $899

1 month ago

A Mac mini with 16 gigabytes of memory now costs 899 dollars, and it ships a chip with Neural Accelerators in every graphics core. That is the first time the cheapest Mac has been a genuinely capable machine for running language models on hardware you own. So the useful question is which models actually fit, at each price.

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Starting at $899
  2. 0:18Memory is the gate
  3. 0:37What $899 runs
  4. 0:3916 GB, the base machine
  5. 0:5732 GB changes the answer
  6. 1:17The ceiling
  7. 1:19What 512 GB fits
  8. 1:42Fit is not speed
  9. 2:03Past one box
  10. 2:05Four Studios, one memory pool
  11. 2:25The floor moved
Show transcript

Starting at $899

LOCAL LLM / APPLE 202601

Run a real LLM on your desk, starting at $899.

The cheapest Mac now ships Neural Accelerators in every graphics core. What fits at each price is the useful question.

Apple Mac mini
Hardware image: Apple Newsroom, Aug 25 2026

A Mac mini with 16 gigabytes of memory now costs 899 dollars, and it ships a chip with Neural Accelerators in every graphics core. That is the first time the cheapest Mac has been a genuinely capable machine for running language models on hardware you own. So the useful question is which models actually fit, at each price.

Memory is the gate

THE ONE LIMIT02
Before any of the numbers

The chip sets the speed. The memory sets what runs at all.

Every tier below is really a memory tier. The silicon is the same family.

2 nm
First 2nm Mac chip
170 GB/s
Memory bandwidth
13.5×
Prompt processing vs M1
Apple: M6, 12-core CPU, 170GB/s; LM Studio prompt processing 13.5× M1, 4.8× M4

Before any of the numbers, one limit worth stating. The chip decides how fast a model runs. The memory decides whether it runs at all. The M6 is Apple's first 2-nanometer chip, with 170 gigabytes per second of memory bandwidth. Apple measured prompt processing in LM Studio at 13.5 times the M1, and 4.8 times the M4.

What $899 runs

PART 0103
01
What $899 runs

Start at the bottom of the lineup.

16 GB, the base machine

ENTRY TIER / 16 GB04

The base machine holds one serious model.

gpt-oss-20b
20.9B total · 3.6B active
12.8 GiB
80% of a 16 GB machine
Mac mini on a desk
Checkpoint size and parameter counts: OpenAI gpt-oss model card

16 gigabytes is the base configuration, and it sets a hard ceiling. OpenAI's gpt-oss-20b checkpoint is 12.8 gibibytes, so it fits with room left for context. It carries 20.9 billion parameters in total but activates only 3.6 billion for each token, which is why a machine this size can keep up with it.

32 GB changes the answer

32 GB / THE SWEET SPOT05

Double the memory and a flagship coding model fits.

17 GB
Qwen3.6 27B at 4-bit
77.2%
SWE-bench Verified
262K tokens
Context window

It beats the previous Qwen flagship, a 397-billion-parameter model, on the same benchmark.

Qwen3.6-27B model card, Apache 2.0, April 2026 · 4-bit size from Q4_K_M builds

Move up to 32 gigabytes and the answer changes. Qwen3.6 27B is a dense model that runs in about 17 gigabytes at 4-bit, and it scores 77.2 percent on SWE-bench Verified. That beats the previous Qwen flagship, which carried 397 billion parameters. A coding model at that level, sitting on a desk, is genuinely new this year.

The ceiling

PART 0206
02
The ceiling

Now the other end of the lineup.

What 512 GB fits

MAC STUDIO / 512 GB07

One desktop reaches 410 GB of model.

gpt-oss-120b
116.8B total
60.8 GiB
Qwen3-235B-A22B
4-bit, 1K context
124 GB
Llama 3.1 405B
dense, 4-bit
217 GB
DeepSeek-R1 671B
4-bit, 16K context
410 GB
Measured peak memory: oMLX on M3 Ultra 512 GB · gpt-oss checkpoint: OpenAI

At the top of the lineup the Mac Studio takes 512 gigabytes of unified memory at 1.2 terabytes per second. That fits gpt-oss-120b at about 61 gibibytes, Qwen3 235B at about 124 gigabytes, dense Llama 405B at about 217, and DeepSeek R1 reaching about 410 gigabytes with 16,000 tokens of context.

Fit is not speed

THE CATCH08

Loading it and using it are different problems.

28 tok/s
Qwen3 235B · 22B active
19.3 tok/s
DeepSeek R1 · 37B active
2.9 tok/s
Llama 405B · all of it

Speed tracks active parameters, not total size. The 671-billion model runs six times faster than the 405-billion one.

Measured on M3 Ultra 512 GB at 4-bit, 1K context: oMLX benchmarks

Fitting a model and using it are separate problems. On an M3 Ultra with the same 512 gigabytes, Qwen3 235B generated about 28 tokens per second, because it activates only a fraction of its weights for each token. DeepSeek R1 reached 19.3. Dense Llama 405B managed about 2.9. Memory buys the load. Architecture decides whether you can work with it.

Past one box

PART 0309
03
Past one box

Now, past a single machine.

Four Studios, one memory pool

THUNDERBOLT 5 CLUSTER10

Four Mac Studios share one memory pool.

3×
Inference vs one system
1.6T params
DeepSeek V4-Pro, 49B active

Thunderbolt 5 carries 120 Gb/s, and RDMA lets the machines read each other's memory directly.

Apple Mac Studio
Apple: clustering over Thunderbolt 5 + RDMA, up to 3× distributed inference · DeepSeek V4-Pro model card

Apple designed for the case where one machine runs out. It says Thunderbolt 5 and RDMA let several Mac Studios pool their memory, and that a cluster of four delivers up to 3 times the AI inference performance of a single system. That is the range where something like DeepSeek V4-Pro, 1.6 trillion parameters with 49 billion active per token, stops needing a data center.

The floor moved

WHAT TO TAKE AWAY11

Memory decides what loads. Architecture decides what you can use.

$899
Runs gpt-oss-20b
32 GB
Runs Qwen3.6 27B
512 GB
Runs DeepSeek R1
bisque.today/p/siderakis · Apple Newsroom, oMLX, OpenAI and Qwen model cards

The limit is worth restating at the end. Memory decides what loads, and architecture decides whether it is fast enough to work with, so the largest dense model on this list still crawls. But the floor moved a long way this year. Apple's Mac revenue grew 29 percent last quarter to 10.4 billion dollars. You can run a real LLM on your desk now, starting at 899 dollars.