Related article on how LLMs are force fed information line by line https://amistrongeryet.substack.com/p/unhobbling-llms-with-knowledge-in-the-world https://am

Related article on how LLMs are force fed information line by line https://amistrongeryet.substack.com/p/unhobbling-llms-with-knowledge-in-the-world https://amistrongeryet.substack.com/p/unhobbling-llms-with-k... > Our entire world – the way we present information in scientific papers, the way we organize the workplace, website layouts, software design – is optimized to support human cognition. There will be some movement in the direction of making the world more accessible to AI. But the big leverage will be in making AI more able to interact with the world as it exists. > We need to interpret LLM accomplishments to date in light of the fact that they have been laboring under a handicap. This helps explain the famously “jagged” nature of AI capabilities: it’s not surprising that LLMs struggle with tasks, such as ARC puzzles, that don’t fit well with a linear thought process. In any case, we will probably find ways of removing this handicap