3 ms·
> they don't fundamentally "get it" There's no clear decision criteria for this. Do trick questions demonstrate that most people don't "get it"? And, well, old
by red75prime 9d ago
> they don't fundamentally "get it"
There's no clear decision criteria for this. Do trick questions demonstrate that most people don't "get it"? And, well, older model saying dumb things doesn't establish a general principle that LLMs don't "get it" in general.
> The sample efficiency is just crazy low
Autoregressive pretraining requires huge amount of data to go from a blank state to a somewhat functional model. Fine-tuning, LORA, reinforcement learning of foundation models and in-context learning are much more sample efficient.
> Chinese room
...creates a wrong intuition that by cranking a Leibniz's mill you are somehow responsible for whether it understands something or not.
- rogerrogerr 9d ago> Do trick questions demonstrate that most people don't "get it"? "Should I walk to the car wash" is hardly a trick question. If a human told me to walk to the car wash because it's so close, I would say that demonstrates they don't "get it".
- red75prime 9d agoI don't see that much difference with "A plane crashes on the border of the United States and Canada. Where do they bury the survivors?" Fast thinking fails to activate slow thinking.