4 ms·
It doesn't know anything at all, it just puts probable sequences of words together, for some definition of probable.
by topaz0 4y ago
It doesn't know anything at all, it just puts probable sequences of words together, for some definition of probable.
- wongarsu 4y agoIt knows things in the sense of "you can ask it and it gives you a relevant and factual answer". It can also transfer knowledge to new situations to a degree. But it doesn't know everything, and there are stricter definitions of the word knowing where GPT (almost certainly) knows nothing. But just because the last layer outputs probabilities for tokens, doesn't mean you can't have intelligence in the layers above that. I don't think "it generates a chain of token pobabilies" is really disqualifying.
- flangola7 4y agoThe thing that doesn't know anything will still take your job.
- topaz0 4y agoNice. I never really liked working.
- flangola7 4y agoWhile I agree, it will probably also kill us (or at least disrupt our lives in unfathomable ways). Either on the orders of someone else, in the social unrest when unemployment is 70% and basic concepts of human existence are torn to pieces, or when it decides our atoms could be used to increase its reward function value.