3 ms·
> The next word it spouts is chosen at random from a list of likely possibilities predicted by the training set. That random word then used as basis for choosi
by Izkata 4y ago
> The next word it spouts is chosen at random from a list of likely possibilities predicted by the training set. That random word then used as basis for choosing the next (random) word. After a few words, the resulting sequence chosen words is very unlikely have every been espoused by a parrot, or anything else.
The GPTs are a bit different - you're describing a Markov chain, they're something new called transformers.