3 ms·
The upper limit is on human text, especially of very high quality and original. But if LLMs use other sources of learning signal, like AlphaZero who trained in
by visarga 2y ago
The upper limit is on human text, especially of very high quality and original. But if LLMs use other sources of learning signal, like AlphaZero who trained in pure self play, that has no upper limit. It's just a slow, iterative process, and it requires social aspects.
The path ahead to AGI is deceitful, there are no gradients leading towards it. It's based on exploration and discovery. It works in populations for reasons of diversity - evolution is that way. And evolution is a slow process, not a singularity kind of event.
- binkethy 2y agoI find the presumption of an AGI to be an article of religious faith. I realized, at some point this past year, that silicon valley is a religious center emitting theology and doctrine. I am an apostate. Technology does not have any innate vector for linear development. The choice to amplify dystopian social trends remains a wrongful choice. So-called AI is bad for humanity and the planet, in finite terms at this moment in time. It's essence is wrongful. Turning bad ideas up to 11 does not make them good ideas.