Needle 2: the memory budget is written first

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

1. 1Needle 2 · a model that turns what you say into an exact command0:00
2. 2It answers only in the functions you declared0:16
3. 3Memory is the hard limit on a watch or a phone0:35
4. 4The memory budget is fixed first, and it decides the most this can hold0:53
5. 5The model cannot forget what it is allowed to do1:20
6. 6The rule comes from your code, not from the model1:40
7. 7It trades five points of accuracy for a model a fraction of the size2:10
8. 8Builds for sixteen kinds of device, and a 13.7 MB model file2:27
9. 9A model sized by what the device can spare2:44