Fair enough - he discusses GPT-4 search halfway down the article, but by the end is discussing self-improving AI. Certainly compute to test ideas (at scale) is

Fair enough - he discusses GPT-4 search halfway down the article, but by the end is discussing self-improving AI. Certainly compute to test ideas (at scale) is the limiting factor for LLM developments (says Sholto @ Google), but if we're talking moving beyond LLMs, not just tweaking them, then it seems we need more than architecture search anyways.