For people who think the number of parameters determines LLM coherence, well, that's a good rule of thumb. But there's an optimal training set data size to para

For people who think the number of parameters determines LLM coherence, well, that's a good rule of thumb. But there's an optimal training set data size to parameters count and gpt3 was trained on too little data. The LLM coming out now trained on more data with fewer parameters and achieve something close. Sure, the 7 billion parameter can't do long outputs. But the 13 billion one is not too bad. They're not a full replacement by any means but for many use cases a local service that is stupider is far preferable to a paid cloud service.