3 ms·
On the contrary, that makes a ton of sense - if you have a fuzzy system with a potential for people to trigger massive resource usage, it would be silly not to
by codingdave 2y ago
On the contrary, that makes a ton of sense - if you have a fuzzy system with a potential for people to trigger massive resource usage, it would be silly not to put a hard restriction on the tasks that are resource-intensive.
- pixiemaster 2y agoyeah, but that is not a hard restriction, since prompts are fuzzy
- 1f60c 2y agoIt's possible that OpenAI have implemented both soft and hard limits, and repeating it in the prompt just prevents it from hitting the user with a scary error.
- utensil4778 2y agoA hard restriction would prevent a malicious prompt from being passed to the model. Instead, it seems they've simply asked the model nicely to pretty please not answer malicious prompts. A hard restriction would be a regex or a simpler model checking your prompt for known or suspected bad prompts and refusing outright.
- ben_w 2y agoYou seem to be suggesting implementing natural language processing as a series of regexes. If NLP was that easy, we wouldn't have needed to invent transformer models, and we'd have had things as capable as ChatGPT about the same time that Microsoft was selling Encarta on CD. The reality is, this soft fuzzy thing is the only practical way to minimise the Scunthorpe problem (and its equivalents for false negatives): https://en.wikipedia.org/wiki/Scunthorpe_problem https://en.wikipedia.org/wiki/Scunthorpe_problem