2 ms·
dynamic quantization-aware training that puts size (in bytes) of the model in the loss
by bilsbie 2y ago
dynamic quantization-aware training that puts size (in bytes) of the model in the loss
- diimdeep 2y agoI know where you saw that https://x.com/realGeorgeHotz/status/1819963680739512550 https://x.com/realGeorgeHotz/status/1819963680739512550 > This is one of the coolest papers I've seen in a while. "Self-Compressing Neural Networks" is dynamic quantization-aware training that puts size (in bytes) of the model in the loss! > My implementation (in @__tinygrad__): https://github.com/geohot/ai-notebooks/blob/master/mnist_self_compression.ipynb https://github.com/geohot/ai-notebooks/blob/master/mnist_sel...
- bilsbie 2y agoTrue. It seemed like a good, concise summary. Maybe I should have credited him.