3 ms·
Context and prompt engineering is the most important of AI, hands down. There are plenty of lightweight retrieval options that don't require a separate vector
by dmezzetti 1y ago
Context and prompt engineering is the most important of AI, hands down.
There are plenty of lightweight retrieval options that don't require a separate vector database (I'm the author of txtai [https://github.com/neuml/txtai https://github.com/neuml/txtai], which is one of them).
It can be as simple this in Python: you pass an index operation a data generator and save the index to a local folder. Then use that for RAG.
- mingtianzhang 1y agoStrongly agree, I also found txtai is super interesting! Thank you for your open-source effort!
- dmezzetti 1y agoYou got it!
- CuriouslyC 1y agoContext and prompt engineering are super automatable. DSPy can automate prompt generation that massively outperforms human prompts, and instead of hand packing context, you can use IR/ML algorithms to intelligently select the optimal context bundle to produce the desired output. Context and prompt engineering are going to be replaced by algorithms, 100%.
- dmezzetti 1y agoYep, context, however you build it.