4 ms·
Wisdom vs knowledge, where the word "knowledge" is doing a lot of work. LLMs don't "know" anything, they predict the next token that has the aesthetics of a res
by heavyset_go 11mo ago
Wisdom vs knowledge, where the word "knowledge" is doing a lot of work. LLMs don't "know" anything, they predict the next token that has the aesthetics of a response the prompter wants.
- Eisenstein 11mo agoIt doesn't seem obvious to me that predicting a token that is the answer to a question someone asked would require anything less than coming up with that answer via another method.
- subb 11mo agoI suspect a lot of people but especially nerdy folks might mix up knowledge and intelligence, because they've been told "you know so much stuff, you are very smart!" And so when they interact with a bot that knows everything, they associate it with smart. Plus we anthropomorphise a lot. Is Wikipedia "smart"?
- Eisenstein 11mo agoWhat is the definition of intelligence?
- anon84873628 11mo agoAbility to create an internal model of the world and run simulations/predictions on it in order to optimize the actions that lead to a goal. Bigger, more detailed models and more accurate prediction power are more intelligent.
- Eisenstein 11mo agoHow do you know if something is creating an internal model of the world?
- anon84873628 10mo agoLook at the physical implementation of how it computes.
- Eisenstein 10mo agoSo you are making the determination based on the method, not on the outcome.
- anon84873628 10mo agoDid I ever promise otherwise? Intelligence is inherently computational, and needs a physical substrate. You can understand it both by interacting with the black box and opening up the box.
- subb 11mo agoDefinitely not _only_ knowledge.
- Eisenstein 11mo agoRight, so a dictionary isn't intelligent. Is a dog intelligent?