2 ms·
Anecdotally from playing around with both, GPT-J seems to struggle compared to GPT-3 when it comes to regurgitating remembered details from the prompt. For exam
by Rebelgecko 5y ago
Anecdotally from playing around with both, GPT-J seems to struggle compared to GPT-3 when it comes to regurgitating remembered details from the prompt. For example when trying to generate short stories I've found that GPT-J will randomly genderswap characters from sentence to sentence, which I never had happen with GPT-3.