4 ms·
If an LLM is trained on just text, then it's internal model can only be based on such text. I think the 'conceit' of LLM as AI advocates is that this model is
by somewhereoutth 3y ago
If an LLM is trained on just text, then it's internal model can only be based on such text.
I think the 'conceit' of LLM as AI advocates is that this model is just as (or at least nearly as) our own internal model - that the 'simplest' model to match the text is indeed our 'real' model that matches reality as a whole. A bit of a stretch surely!
- mjburgess 3y agoLLMs are a redemonstration of the lesson of sun worship: apes are easily fooled. If the output is indistinguishably 'world modelling', so must its mechanism be. There is no 'world' model in a hashmap from questions to answers about a world. There is only the condition that, given those questions, any old ape would accept those answers. Science is required to determine whether a system has properties, such as a rational ecology; ie. a genuine mechanism of environmental coordination. No engineer, no statistician, and certainly no VC HN Hype Man can determine-so. The nature of reality is no up for Big-O equivalences. Systems have properties in virtue of their nature, not in virute of what I will pay $20/mo for
- gaganyaan 3y agoSorry, that's just surface-level tripe. You could make the same dismissive comment about any new technology. You're not saying anything interesting.
- somewhereoutth 3y agoNice try LLMy
- wanderingstan 3y agoI’m no expert, but the word “just” is tricky. You could say mammalian brain is trained on “just” nerve impulses.
- hprotagonist 3y agoyou could, but you’d be wrong. (there are many other signaling modalities!)