Ideally smaller models will get better. For most tasks I don't need the best model in existence, I just need good enough. A small law firm using LLMs for summa

Ideally smaller models will get better. For most tasks I don't need the best model in existence, I just need good enough. A small law firm using LLMs for summaries can probably do it on prem and hire a smart college student to setup a PC to do it. The problem is that's still more difficult ( let's say our hypothetical junior IT only makes 60k a year) than just sending all your private business information to some 3rd party API. You can then act shocked and concerned when your 3rd party leaks the data.