4 ms·
Something else that strikes me is that GPT-3 isn't, to my knowledge, set in stone. It gets occasional training updates. Any update made to the model could subt
by simonw 4y ago
Something else that strikes me is that GPT-3 isn't, to my knowledge, set in stone. It gets occasional training updates.
Any update made to the model could subtly break carefully crafted prompts, or introduce new ways to exploit them.
Will apps built against these models need to only work against exact, frozen model versions to avoid future exploits?
And since it's not feasible to understand exactly how a prompt might be processed, we're effectively doing security engineering here against an unknowable black box. That's pretty alarming!
- bestcoder69 4y agoI thought of a way to check. Be sure to set temperature=0 to get the most accurate results. text-davinci-002: What year is it? It is the year 2020. text-davinci-001: What year is it? It is 2019. davinci-instruct-beta: What year is it? It is the year of our Lord, 1887. Easy enough.
- visarga 4y agoIf you want to make sure the model is up to date you should include a bunch of data in the prompt - like the k-nearest neighbours in your up to date corpus, or API results (time, weather), or fresh search results. The model can be very good at integrating side information you provide. The model without context is just a language processor, not a reliable information store.
- muzani 4y agoThe text-davinci models are also much less interesting for content generation. It's a bit sad that the interesting models are somewhat "hidden".
- stavros 4y agoWhich ones are the interesting ones?
- muzani 4y agodavinci-instruct-beta and davinci. They're not as encouraged, likely because of the security holes.
- stavros 4y agoThank you, I made a GPT-3-generated podcast (https://deepdreams.stavros.io https://deepdreams.stavros.io) and noticed a big drop in text quality with text-davinci-002. I thought it was me, but it's great that you confirm it.
- muzani 4y agoI really don't understand why this was downvoted, lol. A comment refuting it would be nice. Simple prompt of "Write a tagline for a vegan ice cream shop:" text-davinci-002: The best ice cream in town, and it's vegan! davinci-instruct-beta: Finally, an ice cream you can feel good about.
- visarga 4y agoYou make an evaluation set and only apply the new model when the score improves. In time you extend your evaluation set to include all the edge cases you discover in production. If the evaluation set is large enough you can have a degree of confidence. It's more like working with people than working with software - we have exams for people, but exams can only sample knowledge in a limited way.
- teraflop 4y agoBy "score", do you mean manually reviewing and rating the outputs from the evaluation set every time the model changes? Because it's hard to imagine an automated evaluation system that would be sophisticated enough to tell whether the outputs were getting better or worse -- unless, again, it was as smart as GPT-3.