3 ms·
I'm kind of surprised GPT-3 doesn't "understand" haiku. You'd think it could extrapolate the rules? The logs are broken!, Sysadmin sweeps up the leaves, The da
by phaemon 6y ago
I'm kind of surprised GPT-3 doesn't "understand" haiku. You'd think it could extrapolate the rules?
The logs are broken!, Sysadmin sweeps up the leaves, The database cried
- rictic 6y agoThe encoding used by GPT-2 and GPT-3 greatly obscures many of the textual properties of words. This at least partly accounts for why it has so much trouble with meter, rhyme, syllables, and some math. More info: https://www.gwern.net/GPT-3#bpes https://www.gwern.net/GPT-3#bpes
- stochastimus 6y agoThanks for putting that info here!
- deleted 6y ago[deleted]