Try providing the LLM the necessary context and you'll be pleasantly surprised. The problem is that we haven't created proper 'inputs' (data pipelines) into LLM

Try providing the LLM the necessary context and you'll be pleasantly surprised. The problem is that we haven't created proper 'inputs' (data pipelines) into LLMs. But that is going to change this year with agents, and an entirely new software paradigm will emerge from it.