4 ms·
What can I say, PaLM is scary.
by FeepingCreature 5y ago
What can I say, PaLM is scary.
- NoGravitas 5y agoThe hand-picked examples are pretty scary, but I'm also reasonably sure that AGI is not going to come (directly) from LLMs no matter how big they get. Reasoning: https://medium.com/@emilymenonbender/on-nyt-magazine-on-ai-resist-the-urge-to-be-impressed-3d92fd9a0edd https://medium.com/@emilymenonbender/on-nyt-magazine-on-ai-r...
- FeepingCreature 5y agoSeems too focused on the NYT article? I don't think this because the NYT said so, I think this because PaLM's chains-of-thought approach seems to match how my own brain works. I think LMs have huge intelligence overhang atm that is hidden by the way they are forced to respond. If we figure out how to train LMs with propagation through hidden chains of thought, we'll see a huge jump in capability, and also this is the obvious next step that the industry will aim for.