4 ms·
I wonder, have you also done any work on actually improving performance by enhancing the prompt or something similar? I always thought a product like this that
by aleksiy123 2y ago
I wonder, have you also done any work on actually improving performance by enhancing the prompt or something similar?
I always thought a product like this that could empirically decrease costs for the same performance or increase performance for a small increase in cost would have a fairly simple road of justifying its existence.
- ramoz 2y agoI think dspy aims to do this: https://github.com/stanfordnlp/dspy https://github.com/stanfordnlp/dspy
- aleksiy123 2y agoCool thanks for the link very interesting.
- danlenton 2y agoAs outlined, DSPy is a create tool for this. Currently their focus is on optimizing in-context examples, but their broader vision includes optimising system prompts for intermediate LLM nodes in an agentic system as well. We uploaded an explainder video about DSPy last week! Feel free to check it out: https://youtu.be/kFB8kFchCH4?si=0YKAVcpKJjogP1sX https://youtu.be/kFB8kFchCH4?si=0YKAVcpKJjogP1sX