3 ms·
Worth remembering that these bots are uniquely badly positioned to talk about their own abilities, because their training data by definition existed before they
by simonw 3y ago
Worth remembering that these bots are uniquely badly positioned to talk about their own abilities, because their training data by definition existed before they were created.
One example of this: GPT-4 can talk at length about GPT-3 but doesn't know anything about itself.
- pixl97 3y agoYou'd have to test the bot, then feed those test results back into the bot. It's not really any different than people testing and iterating on their own abilities, it's just that humans are continuous learning and LLMs are not. If someone asked if I could build a decent shelf, the answer is probably, but I wouldn't really know till I tried and measured my results since I've not done exactly that before.