3 ms·
This is a great test because it’s something you could teach an elementary school kid in an hour.
by ipnon 1y ago
This is a great test because it’s something you could teach an elementary school kid in an hour.
- Davidzheng 1y agois this a joke
- Telemakhos 1y agoNo, it’s easy if the kid already knows the alphabet. Latin scansion was standard grade school material up until the twentieth century. Greek less so, but the rules for it are very clear-cut and well understood. An LLM will regurgitate the rules to you in any language you want, but it cannot actually apply the rules properly.
- Davidzheng 1y agois ancient greek similar enough to modern day greek that an elementary school kid could learn to compose anything not boilerplate in an hour? Also, do you know that if you fed the same training material you need to train the kid in an hour into the LLM it can't do it?
- pxc 1y agoTo outperform GPT-5 in this case, all the kid needs to do is correctly recognize the syllable stress constraint. Even if they can't quickly compose many such poems, they could still be able to tell when something they've written doesn't match the constraints.