3 ms·
On the other hand, once you have a large model, you can use various distillation techniques to train smaller models faster and with better results. Meta seems t
by int_19h 2y ago
On the other hand, once you have a large model, you can use various distillation techniques to train smaller models faster and with better results. Meta seems to be very successful doing this with Llama, in particular.
- coder543 2y ago> Meta seems to be very successful doing this with Llama, in particular. Kind of sort of: https://news.ycombinator.com/item?id=42391096 https://news.ycombinator.com/item?id=42391096