Information compression is nothing new. Of course if you are trying to get an LLM to produce accurate data about geography, it would make sense that instead of

Information compression is nothing new. Of course if you are trying to get an LLM to produce accurate data about geography, it would make sense that instead of trying to catalog every fact in a lookup table, there would be some sort of model that you can run queries through. The LLMs just happen to be a neat way of building those models automatically from data. The problem is, this sentiment of path towards AGI assumes that everything (i.e our physical reality) can be compressed. Which is highly likely not true. The future of AI is basically better and better compression with more data sources. You will be able to do things like ask how to build a flying car in your garage, and it will give you step by step instructions on what things you need to order from where, including CAD drawings to get custom made CNC parts, and how to put it all together (including software to run it). As far as AGI goes, its possible that through AI assisted technology we will be able to measure synapses of a human brain in fine enough detail, or somehow mass surveil the entire population of earth and derive human brain models from that. And then, with optimizations on that, we can potentially arrive at the most efficient human brain in terms of some metric, and we will have very good robotic assistants, but nothing really beyond that.