4 ms·
Yes, to me this seems to address LeCun's objection, or at least point the way to something that does. It seems possible to modify this into something that can i
by modeless 2y ago
Yes, to me this seems to address LeCun's objection, or at least point the way to something that does. It seems possible to modify this into something that can identify and correct its own mistakes during the sampling process.
- vessenes 2y agoWell, I think I understand LeCun has a broader critique that any sort of generated-in-a-vacuum text which doesn't interact with meatspace is fundamentally going to be prone toward divergence. Which, I might agree with, but is also, just, like, his opinion, man. Or put less colloquially, that's a philosophical stance sitting next to the math argument for divergence. I do think this setup can answer (much of) the math argument.