3 ms·
I meant how is knowledge extraction done by a language model different from knowledge extraction done by a human scientist?
by p1esk 6y ago
I meant how is knowledge extraction done by a language model different from knowledge extraction done by a human scientist?
- wpietri 6y agoSorry, I don't understand the question.
- p1esk 6y agoGPT-3 does some form knowledge extraction, right? You said above: "There's also the kind of meaning that scientists and researchers talk about when they extract knowledge from data." So if we agree that in both cases some form of knowledge extraction is happening, I wonder how these two forms compare.
- wpietri 6y agoA search for "GPT-3 knowledge extraction" doesn't yield much, so I don't know what you're talking about. But as far as I'm concerned, knowledge exists in the heads of people, so I don't think we agree on that.
- p1esk 6y agoknowledge exists in the heads of people How is this knowledge encoded in the heads of people? Perhaps through the choice of synapse strength and connectivity between neurons? What is being encoded in GPT-3 weights as it reads through millions of pages of text? How is it different from tuning biological synapses? Still don't know what I'm talking about? It's OK, neither do I :)