3 ms·
> something that I know is only working from words as a source. Your intuition about the architecture might be causing the distrust. Yes, the ends of the model
by cjbprime 4y ago
> something that I know is only working from words as a source.
Your intuition about the architecture might be causing the distrust. Yes, the ends of the model are words in and words out (although GPT-4 is now multi-modal and can accept images as input too), but that doesn't mean the calculations in the middle are dealing in words. The "language" in "large language model" is misleading. It's a large generalized model that imports and exports language.
- graypegg 4y agoThat is totally possible, the explosion of stuff around this space has kind of blindsided me, so I don’t have much intuition for precisely how these models are built. It all still feels rather “attribute magic to complexity” to say that there’s some human element skimmed off the patterns of our language, hidden in the coefficients somewhere. I’m also not a magician, so really who am I to say :)