3 ms·
The interesting part of context engineering (the actual engineering part) is figuring out how to gather the information the LLM needs to do a task correctly fro
by thorum 1y ago
The interesting part of context engineering (the actual engineering part) is figuring out how to gather the information the LLM needs to do a task correctly from your system. For example, the secret sauce of GitHub Copilot is how it decides what parts of your codebase to show the LLM. This is surprisingly hard when you need something other than simple RAG. In many cases the data source you need doesn’t exist and you have to build it.
The prompt engineering side of the problem (how you structure your prompt) is trivial by comparison and will become less and less relevant as frontier models improve.