DiffusionGemma, Google’s open model that writes text a whole block at a time

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

1. 1DiffusionGemma, Google’s open model that writes text in parallel0:00
2. 2About 1,500 word-pieces a second on one chip, at a real accuracy cost0:14
3. 3A whole block at once, instead of one word at a time0:45
4. 4About 20 word-pieces filled in on each pass, across a 256-word canvas1:15
5. 5Built by converting Gemma 4, on under a tenth of its training data1:52
6. 6Behind its parent across the board, closest on knowledge and furthest on math2:26
7. 7Open weights on Hugging Face, the report on arXiv3:04
8. 8The speed is real, and so is the cost in accuracy3:16