3 ms·
Agreed, there's definitely a lot of value in LLMs even if they don't really have an understanding of the world.
by jfim 3y ago
Agreed, there's definitely a lot of value in LLMs even if they don't really have an understanding of the world.
- godelski 3y agoIt is quite interesting to me that people latch onto the world model so much as if it is highly significant or a lack of a world model invalidates LLMs. Personally I still believe they're magical (in the proverbial sense) and amazing tools even though I also believe they are just complex stochastic machines that have very little understanding of the things they are doing. That just tells me how cool and amazing that statistics is. I honestly don't know anyone that thinks LLMs are useless things, despite knowing a large number of people that are highly critical of them. But those are very different metrics. I don't know why we can't have nuance in things, why they need to either be a gift from god or a pile of shit.