I would look at: 1. Building blocks. Your core is GPT-4 level intelligence, similar to a transistor. Other things can be built around that. RAG. Functions. Age

I would look at: 1. Building blocks. Your core is GPT-4 level intelligence, similar to a transistor. Other things can be built around that. RAG. Functions. Agents. Building blocks lead to bigger ones. Other forms of blocks. Multimodal. Try out Suno and Midjourney if you haven't. Building blocks are composed of smaller blocks, and as engineers, this is where your salaries are made. 2. Amdahl's & the subsequent Gustafson's Law. More resources will have diminishing gains, until they hit a point where they unlock new uses. GPUs and cloud are a cool side effect from the computing revolution, and they solve all kinds of problems they were never invented for. You'll see LLMs slow down in problem solving then suddenly someone figures out how to build self-3D printing machines or something. 3. Old, uncool paradigms. Procedural generation is incredibly good at controlling quality. LLMs are like play doh, and proc gen gives it a skeleton. Evolutionary programming goes the other way. You can give an agent a problem to solve, and now it's able to figure out paths or branch agents on the way there. 4. Combos with existing blocks. LLM agents + crypto wallet leads to agent ecosystems. Multimodal vision/hearing can also be combined with all kinds of things. LLMs will be available to all apps, and it'll be cheaper than TTS was. RAG will make search cheaper, not enough to threaten Google, but you can quickly search interview questions or emergency medical treatments. I'd say don't spend too much effort predicting. But play with new blocks as they form - several will be unimportant, some will matter. Two blocks together could be amazing. Brush up on the old paradigms that are no longer taught in average universities.