3 ms·
The site you linked asserts "meta-learning" is happening in GPT3 without any evidence of it
by typon 6y ago
The site you linked asserts "meta-learning" is happening in GPT3 without any evidence of it
- fossuser 6y agoIsn't the capability to answer arithmetic prompts without the exact equation being present in the training data evidence? I'm not an AI researcher so I only have a lay-person's opinion from reading about this kind of thing via things like that blog post (I also don't have OpenAI access to play with the API myself), but if that is an accurate statement it seems like pretty good evidence of figuring out the underlying mathematical rules. I think this could be a path towards scaling being more effective than people think. I sense though that you're just arguing from a position of motivated reasoning based on a pre-existing conclusion rather than actually trying to look at new things that may contradict what you already believe to be true. Repeated one sentence responses arguing that none of this is evidence just isn't worth time to respond to. In the end we'll see what ends up happening.
- deleted 6y ago[deleted]