> It's also in danger of becoming totally obsolete with further LLM advances (Claude 3 already really good at needle in the haystack tasks) Maybe, but for ever

> It's also in danger of becoming totally obsolete with further LLM advances (Claude 3 already really good at needle in the haystack tasks) Maybe, but for every haystack that an LLM can search, RAG could search an even larger one. I don't think RAG is a killer app but I think tools that help LLMs find the right context will continue to be useful. > Doubling down on domain knowledge I'm a dev, but this is my main strategy right now. I am digging deep into my corner of fintech and hoping that will stave off some of the disruption I see coming for tech. Personally, I don't see why an AI couldn't also become a domain expert in my niche, but it should buy me some time and potentially align me with some powerful stakeholders (portfolio managers just need to convince the big money that a human touch is good and I will still be business).