It is known that LLMs are possible, so there is no stoping it. It's too late to think about if we like it. All ideas and skills are fair game now, but LLMs lac

It is known that LLMs are possible, so there is no stoping it. It's too late to think about if we like it. All ideas and skills are fair game now, but LLMs lack in depth in all of them. No LLM system is better than a domain expert. Maybe with better training data we will have better models. There are some models trained only on public domain and synthetic (generated) data. So probably LLMs won't learn directly from our works. They need better data than internet stuff, human text is not good enough. See the Microsoft model Phi-1.5 [1], trained on diverse synthetic text of high quality. [1] https://youtu.be/0lF3g4JtY9k?t=531 https://youtu.be/0lF3g4JtY9k?t=531