2 ms·
Yes, it can memorize short phrases similar to how it "remembers" words. It's trained on a web corpus that includes and emphasizes Wikipedia. The model is big en
by skybrian 6y ago
Yes, it can memorize short phrases similar to how it "remembers" words. It's trained on a web corpus that includes and emphasizes Wikipedia. The model is big enough to memorize some things, though not in such a way that they can reliably be retrieved, and it will make stuff up when it doesn't remember. So it's not Google but sometimes it's reminiscent.
Here is a Q&A conversation where I found some things it "learned".
https://tildes.net/~games/qmc/ai_dungeon_dragon_model_upgrade#comment-5dcc https://tildes.net/~games/qmc/ai_dungeon_dragon_model_upgrad...