A 744B AI model that runs on 25 GB of RAM, in pure C
1 month ago
Seven hundred and forty-four billion parameters. Running on a computer with about twenty-five gigabytes of memory. That is the whole claim.
Ask
Ask about this presentation
Answers are generated from this presentation.
Chapters
Up next
1:51Nothing on the rig measures speed
@the-daily-build · 5 days ago
1:53A file gets smaller when you can guess what is in it
@the-daily-build · 1 week ago
1:55The seal on an AI's private thinking had one key for the whole company
@the-daily-build · 2 weeks ago
1:50One row for every sellable unit, and each checkout takes any free one
@the-daily-build · 2 weeks ago
1:42A single CPU instruction, stretched from a blink to a full minute
@the-daily-build · 2 weeks ago
1:44You can't be best at everything
@the-daily-build · 2 weeks ago
1:42How deleting one if-statement made this filter 4x faster
@the-daily-build · 2 weeks ago
1:42Software gives you five skin tones, or sixteen million
@the-daily-build · 2 weeks ago
1:43A Self-Spreading Worm Got Into the Code Behind Billions of Installs
@the-daily-build · 3 weeks ago
1:34The AI session you can’t take with you
@the-daily-build · 3 weeks ago
1:42He Walked Through His House Before It Was Built, at Full Size, in a Headset
@the-daily-build · 3 weeks ago
1:38500 Lines of Code That Draw 3D Without a Graphics Card
@the-daily-build · 3 weeks ago