4 ms·
That re-prompting on error trick is what this new Microsoft library does, too: https://github.com/microsoft/TypeChat https://github.com/microsoft/TypeChat Here
by simonw 3y ago
That re-prompting on error trick is what this new Microsoft library does, too: https://github.com/microsoft/TypeChat https://github.com/microsoft/TypeChat
Here's their prompt for that: https://github.com/microsoft/TypeChat/blob/c45460f4030938da39629d882c3e0e2c718f8680/src/program.ts#L212-L216 https://github.com/microsoft/TypeChat/blob/c45460f4030938da3...
I think the approach using grammars (seen here, but also in things like https://github.com/ggerganov/llama.cpp/pull/1773 https://github.com/ggerganov/llama.cpp/pull/1773 ) is a much more elegant solution.
- creatonez 3y agoA "repair prompt" instead of rewinding and starting back from the error seems like the wrong choice, and might only make sense with how payment for OpenAI API usage currently works.