3 ms·
Seems too focused on the NYT article? I don't think this because the NYT said so, I think this because PaLM's chains-of-thought approach seems to match how my o
by FeepingCreature 5y ago
Seems too focused on the NYT article? I don't think this because the NYT said so, I think this because PaLM's chains-of-thought approach seems to match how my own brain works. I think LMs have huge intelligence overhang atm that is hidden by the way they are forced to respond. If we figure out how to train LMs with propagation through hidden chains of thought, we'll see a huge jump in capability, and also this is the obvious next step that the industry will aim for.