3 ms·
But when it gets on a roll producing normal/boring things, it will fill out the list with normal/boring things. With these kinds of repetitive tasks I find tha
by williamcotton 4y ago
But when it gets on a roll producing normal/boring things, it will fill out the list with normal/boring things.
With these kinds of repetitive tasks I find that the chatbot interface is not the best and that using an API is much better.
The chatbot approach is constantly feeding the history of the “conversation” back to the LLM. However, if you are asking for a fresh completion every time but with a number of few-shot examples of the output you can get much more reliable outputs.
This applies to the data formatting examples as well. If enough examples are provided in the prompt it tends to lock into the pattern very well.
- Veen 4y agoI don't use the API programmatically, but I often move from ChatGPT to the OpenAI Playground when I'm not getting the results I want. It's just as convenient as chat, but it lets you play around with the Temperature and other factors that influence the output.
- williamcotton 4y agoThat’s a great point and thanks for reminding me! I should use that more often as well as it the UI is pretty convenient for rapid iteration. As for why I’m specifically using the API is that I tend to eval(completion), sometimes on generated functions, but sometimes just to have a function like toNum() in scope to turn “1,356” into 1356! Which could be another method used for errant {size: “3x5”} instead of {w:3,h:5}… the hallucinations become somewhat predictable and hence parsable in ways that reduce errors drastically!