2 ms·
We've been able to produce that kind of speech before though. I wrote programs using Markov Chains 10 years ago which could produce almost real sounding speech
by saberience 6y ago
We've been able to produce that kind of speech before though. I wrote programs using Markov Chains 10 years ago which could produce almost real sounding speech but I didn't think it was intelligent.
The GPT models are essentially massive databases along with the use of probability models for how words are connected. Do you think that means intelligence? Can it generate new knowledge of things outside its database? Can it generate novel theories for things outside its understanding?
The GPT models often generate streams of text which can found word for word in its database, i.e. it's not really generating anything new as just mimicking. When a parrot repeats a human, it doesn't understand what the words mean, it's just making sounds.
- thu2111 6y agoBut at some level our own brains are just very large databases and very good prediction engines, at least when running on auto-pilot and lacking any deep understanding. Hence the phenomenon of BS artists. Sad to say but I've heard speeches that were less coherent and interesting than what GPT-3 produces.