3 ms·
This wonder if there’s similar research on reducing the amount of data (by improving its quality) for pretraining
by yalok 2y ago
This wonder if there’s similar research on reducing the amount of data (by improving its quality) for pretraining
- sebzim4500 2y agoYeah that was the idea behind the Phi series of models. It gets good benchmark results but you can still tell something is missing when you actually try to use it for anything.