4 ms·
GPT-3 stays incredibly in-topic. You can give it logic problems it won't be able to solve, but GPT-3 is capable of things that, as a GOFAI supporter, I never th
by Iv 5y ago
GPT-3 stays incredibly in-topic. You can give it logic problems it won't be able to solve, but GPT-3 is capable of things that, as a GOFAI supporter, I never thought brute-force connexionist approach could do. I am now very cautious before saying a task can't be done by DL because it requires "understanding".
These approaches discover concepts and the relationship between them, and use that in their tasks. It is not far-fetched to say that there is some kind of understanding there.
For now we have trained it to generate fake text and basically made a master bullshitter, but I have no doubt that it can easily extract meaning and intent from text.
- perl4ever 5y ago>I have no doubt that it can easily extract meaning and intent from text. Have you met humans? People do not supply complete or self consistent information on what their goals are. They do not form objections to the output of a program based on an accurate and complete model of it either. Also, they hate to communicate via text - how many times have you heard "ugh, let's discuss it on a call"? But that does not mean you can BS them endlessly. The fact that people have no idea about the technical details doesn't mean they are going to accept failure. I'd like to see an AI that can dominate https://en.wikipedia.org/wiki/Nomic https://en.wikipedia.org/wiki/Nomic