3 ms·
I think what Terry is saying is that with the current set of tools, there are classes of problems requiring cleverness: where you can guess and check (glorified
by blobbers 10mo ago
I think what Terry is saying is that with the current set of tools, there are classes of problems requiring cleverness: where you can guess and check (glorified autocomplete), check answer, fail and then add information from failure and repeat.
I guess ultimately what is intelligence? We compact our memories, forget things, and try repeatedly. Our inputs are a bit more diverse but ultimately we autocomplete our lives. Hmm… maybe we’ve already achieved this.
- judahmeek 10mo agoSome one recently told me that their definition of intelligence was data-efficient extrapolation & I think that definition is pretty good as it separates intelligence from knowledge, sentience, & sapience.
- blobbers 10mo agoCool. I don't know how data-efficient current LLMs are, in the sense that I don't know what they know and don't know. It certainly seems like in some domains, they can can extrapolate, but I don't know what's in their training data.