3 ms·
GPT-3 has an encyclopedic knowledge base that no (single) human brain could match. It loses to human brains in most aspects, but it wins in that one. Other th
by comex 6y ago
GPT-3 has an encyclopedic knowledge base that no (single) human brain could match. It loses to human brains in most aspects, but it wins in that one.
Other than that… well, I don’t even know of any other VLP models. But there are other examples of ML models in general transcending humans, like Watson in Jeopardy, and AlphaGo.
- yunusabd 6y agoTrue, but in the context of computer science, isn't having encyclopedic knowledge a trivial problem? I mean, if you look at it that way, wikipedia itself "transcends" the limits of the human brain, and it's just a database. And a way more efficient one at that, at 50GB vs. 700GB. In the context of AI, Bert already had knowledge embedded into it [1], and it's not considered a VLP model afaik. So it's more of a quantitative improvement, contrary to the claim of the author that there's a qualitative difference between VLP models and everything else. [1] https://syncedreview.com/2020/08/12/how-smart-is-bert-evaluating-the-language-models-commonsense-knowledge/ https://syncedreview.com/2020/08/12/how-smart-is-bert-evalua...