4 ms·
If GPT-3 is trained on a corpus of the entire internet, could you just use it as a search engine by posing questions to it?
by faitswulff 6y ago
If GPT-3 is trained on a corpus of the entire internet, could you just use it as a search engine by posing questions to it?
- freediver 6y agoNo, but it can look deceivingly able to: https://twitter.com/paraschopra/status/1284801028676653060 https://twitter.com/paraschopra/status/1284801028676653060 (and this is how to prime it: https://twitter.com/vybhavram/status/1284803750146617344 https://twitter.com/vybhavram/status/1284803750146617344) The main problem is that GPT3 has a free will of a creative but delusional person and will distort facts as it pleases to maximize its output function score. So, similar to evening news.
- worldsayshi 6y agoHmm, can you turn GPT-3 api into a fact checker by priming it with tuples of (in)correct statements, true/false? And then maybe prime it to add explanations and references for the responses as well.
- wizzwizz4 6y agoYes, but it's only effective for things a few months before its creation; anything after that is just “sounds plausible to GPT-3”. Likewise, its explanations aren't very good unless it has good domain knowledge on the subject; if it doesn't know something, it won't tell you so unless you've primed it with not-knowing being an option. https://www.gwern.net/GPT-3#expressing-uncertainty https://www.gwern.net/GPT-3#expressing-uncertainty