3 ms·
I know where you saw that https://x.com/realGeorgeHotz/status/1819963680739512550 https://x.com/realGeorgeHotz/status/1819963680739512550 > This is one of the
by diimdeep 2y ago
I know where you saw that
https://x.com/realGeorgeHotz/status/1819963680739512550 https://x.com/realGeorgeHotz/status/1819963680739512550
> This is one of the coolest papers I've seen in a while. "Self-Compressing Neural Networks" is dynamic quantization-aware training that puts size (in bytes) of the model in the loss!
> My implementation (in @__tinygrad__):
https://github.com/geohot/ai-notebooks/blob/master/mnist_self_compression.ipynb https://github.com/geohot/ai-notebooks/blob/master/mnist_sel...
- bilsbie 2y agoTrue. It seemed like a good, concise summary. Maybe I should have credited him.