5 ms·
In 2023 GPT-4 was allegedly 1.8T parameters. In 2026 we have ~100x smaller models (10-20B) that handily outperform it, and can indeed run on a laptop.
by wolttam 5mo ago
In 2023 GPT-4 was allegedly 1.8T parameters. In 2026 we have ~100x smaller models (10-20B) that handily outperform it, and can indeed run on a laptop.
- rectang 5mo agoHow does "outperform" translate to the propensity of an LLM to hallucinate?
- operatingthetan 5mo agoThere seems to be a mass delusion about how capable SOTA models actually are. That's my only explanation for how poorly I find them performing in basic knowledge tasks compared to how others describe their prowess.
- rectang 5mo agoI understand you to be implying that I shouldn't trust my perception that there's a meaningful difference in how much different models hallucinate. I will take that under advisement, but I am still interested in the answer to my original question.
- operatingthetan 5mo ago>I understand you to be implying that I shouldn't trust my perception that there's a meaningful difference in how much different models hallucinate. Nope. Also I'm not GP.
- WanderPanda 5mo agoIt highly depends on the task. For math and coding, sure. But for knowledge tasks GPT-4 is wayy better than even SOTA ~100B models. For my knowledge test cases the lines get blurry at >400B