2 ms·
Do you know of any research that tries to take large pre-trained model and make it smaller by cutting out least activated neurons and training it a bit not to l
by scotty79 4y ago
Do you know of any research that tries to take large pre-trained model and make it smaller by cutting out least activated neurons and training it a bit not to loose performance?
- sebzim4500 4y agohttps://arxiv.org/pdf/2301.00774.pdf https://arxiv.org/pdf/2301.00774.pdf
- KRAKRISMOTT 4y agoThe entire field of ML distillation.