3 ms·
Autocomplete in GPT-3 isn't optimization at all, though? The optimization was in the training. I've read that the loops you're talking about come from taking t
by skybrian 6y ago
Autocomplete in GPT-3 isn't optimization at all, though? The optimization was in the training.
I've read that the loops you're talking about come from taking too many high-probability choices compared to real-world text that has some low-probability words.