If anything, LLMs just heighten their abilities. I can generate synthetic datasets of size and quality for training BERT models and the like that would’ve taken

If anything, LLMs just heighten their abilities. I can generate synthetic datasets of size and quality for training BERT models and the like that would’ve taken ages before. Similarly for knowledge distillation from large models to small. It’s never been more exciting times for ML.