3 ms·
Twitter thread: https://twitter.com/OwainEvans_UK/status/1705285631520407821 https://twitter.com/OwainEvans_UK/status/1705285631520407821 https://nitter.net/O
by mellosouls 3y ago
Twitter thread:
https://twitter.com/OwainEvans_UK/status/1705285631520407821 https://twitter.com/OwainEvans_UK/status/1705285631520407821
https://nitter.net/OwainEvans_UK/status/1705285631520407821 https://nitter.net/OwainEvans_UK/status/1705285631520407821
Does a language model trained on “A is B” generalize to “B is A”?
E.g. When trained only on “George Washington was the first US president”, can models automatically answer “Who was the first US president?”
Our new paper shows they cannot!