3 ms·
It parses natural text into a format representing logic, that is the biggest thing to get. Then once you have such a parser you can now make a logical Markov c
by Jensson 4y ago
It parses natural text into a format representing logic, that is the biggest thing to get.
Then once you have such a parser you can now make a logical Markov chain, it predicts the continuation of your text based on continuations of things that looks similar in the logic space rather than the text space, and that is what you get back from the model.
So ChatGPT does what we could have easily done if we had if natural language was more logical. Then we could make a simple model based on all the logic encoded in all writing of humanity that just looks up human done logic similar to what you asked for and then return an average of those logics. Now since you want human language output it now has to translate that back to human text from logic space, and it could be done in English, Spanish, it could speak like a pirate etc.