3 ms·
I thought of a way to check. Be sure to set temperature=0 to get the most accurate results. text-davinci-002: What year is it? It is the year 2020. text
by bestcoder69 4y ago
I thought of a way to check. Be sure to set temperature=0 to get the most accurate results.
text-davinci-002:
What year is it?
It is the year 2020.
text-davinci-001:
What year is it?
It is 2019.
davinci-instruct-beta:
What year is it?
It is the year of our Lord, 1887.
Easy enough.
- visarga 4y agoIf you want to make sure the model is up to date you should include a bunch of data in the prompt - like the k-nearest neighbours in your up to date corpus, or API results (time, weather), or fresh search results. The model can be very good at integrating side information you provide. The model without context is just a language processor, not a reliable information store.
- muzani 4y agoThe text-davinci models are also much less interesting for content generation. It's a bit sad that the interesting models are somewhat "hidden".
- stavros 4y agoWhich ones are the interesting ones?
- muzani 4y agodavinci-instruct-beta and davinci. They're not as encouraged, likely because of the security holes.
- stavros 4y agoThank you, I made a GPT-3-generated podcast (https://deepdreams.stavros.io https://deepdreams.stavros.io) and noticed a big drop in text quality with text-davinci-002. I thought it was me, but it's great that you confirm it.
- muzani 4y agoI really don't understand why this was downvoted, lol. A comment refuting it would be nice. Simple prompt of "Write a tagline for a vegan ice cream shop:" text-davinci-002: The best ice cream in town, and it's vegan! davinci-instruct-beta: Finally, an ice cream you can feel good about.