> The real issue in my opinion is that we will hit practical limits with training data and computational resources well before AGI turns us all into paperclips

> The real issue in my opinion is that we will hit practical limits with training data and computational resources well before AGI turns us all into paperclips [...] I think you are correct, but also I think that even if that were not the case, the Thai Library Problem[1] strongly suggests that AGI will have to be built on something other than LLMs (even if LLM-derived systems were to serve as an interface to such systems). [1]: https://medium.com/@emilymenonbender/thought-experiment-in-the-national-library-of-thailand-f2bf761a8a83 https://medium.com/@emilymenonbender/thought-experiment-in-t...