3 ms·
> Despite an electric shaver-like power efficiency, the human brain has limits that some of the Very Large Parameter models transcend (even if that’s unreliable
by yunusabd 6y ago
> Despite an electric shaver-like power efficiency, the human brain has limits that some of the Very Large Parameter models transcend (even if that’s unreliable today).
Are there any examples where a VLP model actually transcends the limits of the human brain?
- comex 6y agoGPT-3 has an encyclopedic knowledge base that no (single) human brain could match. It loses to human brains in most aspects, but it wins in that one. Other than that… well, I don’t even know of any other VLP models. But there are other examples of ML models in general transcending humans, like Watson in Jeopardy, and AlphaGo.
- yunusabd 6y agoTrue, but in the context of computer science, isn't having encyclopedic knowledge a trivial problem? I mean, if you look at it that way, wikipedia itself "transcends" the limits of the human brain, and it's just a database. And a way more efficient one at that, at 50GB vs. 700GB. In the context of AI, Bert already had knowledge embedded into it [1], and it's not considered a VLP model afaik. So it's more of a quantitative improvement, contrary to the claim of the author that there's a qualitative difference between VLP models and everything else. [1] https://syncedreview.com/2020/08/12/how-smart-is-bert-evaluating-the-language-models-commonsense-knowledge/ https://syncedreview.com/2020/08/12/how-smart-is-bert-evalua...