3 ms·
> These libraries mostly exist as "cope" > nothing more than fancy prompt chains under the hood Some approaches using steering vectors, clever ways of fine-tu
by isaacbmiller 2y ago
> These libraries mostly exist as "cope"
> nothing more than fancy prompt chains under the hood
Some approaches using steering vectors, clever ways of fine-tuning, transfer decoding, some tree search sampling-esque approaches, and others all seem very promising.
DSPy is, yes, ultimately a fancy prompt chain. Even once we integrate some of the other approaches, I don't think it becomes a single-lever problem where we can only change one thing(e.g., fine-tune a model) and that solves all of our problems.
It will likely always be a combination of the few most powerful levers to pull.
- Der_Einzige 2y agoCorrect, when I say "ChatGPT et al", I mean closed source paywalled LLMs, open access LLM personalization is an extreme gamechanger. All of what you mentioned is important, and I'm particularly excited about PyReft. https://github.com/stanfordnlp/pyreft https://github.com/stanfordnlp/pyreft Anything Christopher Manning touches turns to gold.