I agree, it may not be possible to overcome those challenges with LLM's specifically. We could well end up needing something other than LLMs, or new kinds of AI

I agree, it may not be possible to overcome those challenges with LLM's specifically. We could well end up needing something other than LLMs, or new kinds of AIs that use LLMs. No one yet knows.