4 ms·

Yikes. They're actually killing off text-davinci-003. RIP to the most capable remaining model and RIP to all text completion style freedom. Now it's censored/al

Yikes. They're actually killing off text-davinci-003. RIP to the most capable remaining model and RIP to all text completion style freedom. Now it's censored/aligned chat or instruct models with arbitrary input metaphor limits for everything. gpt3.5-turbo is terrible in comparison. This will end my usage of openai for most things. I doubt my $5-$10 API payments per month will matter. This just lights more of a fire under me to get the 65B llama models working locally.

samstave 3y ago
Please ELI5 if I am mis-interpretating what you said: *"They have just locked down access to a model which they basically realized was way more valuable than even they thought - and they are in the process of locking in all controls around exploiting the model for great justice?"*
H8crilA 3y ago
The $5-$10 is probably the reason why they're killing those endpoints.
- superkuh 3y ago
  I don't get it? text-davinci-003 is the most expensive model per token. It's just that running IRC bots isn't exactly high volume.
  - stavros 3y ago
    "Most expensive" doesn't mean "highest margin", though.
    - H8crilA 3y ago
      I meant that it probably isn't high revenue.
bravura 3y ago
I've never used text-davinci-003 much. Why do you like it so much? What does it offer that the other models don't? What are funs things we can with it until it sunsets on January 4, 2024?
- thomasfromcdnjs 3y ago
  The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker/builder ethos if they drop things like davinci-003, which might suck for them in the long run. Consumers over developers.
  - Fyrezerk 3y ago
    The hacker/builder ethos doesn't matter in the grand scheme of commercialization.
    - Robotbeat 3y ago
      It matters immensely in the early days and is the basis for all growth that follows. So cutting it off early cuts off future growth.
    - kromem 3y ago
      Sure - not like most of the infrastructure of pretty much everything online is built on top of projects originating in that space or anything.
    - RugnirViking 3y ago
      How do they want to commercialise it? Do they want moms to tinker on ChatGPT once a month to do their children's homework? Or do they want people to build businesses using their software
deleted 3y ago
[deleted]
system2 3y ago
I built my entire app on text-davinci-003. It is the best writer so far. Do you think gpt3.5 turbo instruct won't be the same?
- raincole 3y ago
  > In the coming weeks, we will reach out to developers who have recently used these older models, and will provide more information once the new completion models are ready for early testing. I guess they'll give you early access to it.
  - system2 3y ago
    Thanks!
Karrot_Kream 3y ago
I wonder if there's some element of face-saving here to avoid a lawsuit that may come from someone that uses the model to perform negative actions. In general I've found that gpt3.5-turbo is better than text-davinci-003 in most cases, but I agree, it's quite sad that they're getting rid of the unaligned/censored model.
- gexla 3y ago
  More likely hardware constraints. They can't get the hardware fast enough to do everything they want to do. So, they free up resources by ditching lower demand models.
kromem 3y ago
Yeah, TextCompletion is much better than ChatCompletion with v3 models. But with davinci at the same price point as GPT-4 I'm hoping the latter is enough of a step up in its variety of vocabulary and nudgeable sophistication of language to be a drop in replacement. Though in general I think there's an under appreciation for just how much is being lost in the trend towards instruct models, and hope there will be smart actors in the market who use a pre-optimization step for instruct prompts that formats it for untuned models. I'd imagine that parameter size to parameter size that approach will look much more advanced to end users just by not lobotomizing the underlying model.
gexla 3y ago
My guess is that they would be fine with continuing to serve all models, but that hardware constraints are forcing difficult decisions. SA has already said that hardware is holding them back from what they want to do. I was on a waiting list for the GPT4 API for like a few months, which I guess is because they couldn't keep up with demand.
LeoPanthera 3y ago
Everyone who complains about being "censored" never gives examples.
- yard2010 3y ago
  I'm trying to create a bot that joins my friends Telegram group and melds into the conversation as if it was a real person. A real person might be the most cute and fun enthusiastic person there is but sometimes it has bad days, or it tells inappropriate jokes, right? People are complicated. Not this bot! No matter what prompt I'm using (with the chat API) it won't lose the happy happy joy joy chatGPT attitude, won't tell inappropriate jokes, won't give advice on certain topics and in general won't talk like a real person, not because of technological limitations.. You can feel it when it's just nerfed. Trying the same prompts that gave nerfed "I am just an AI I can't speculate about the future" bs on completion API gave somewhat better results, but most of the time they were flagged as breaking the guidelines which is a TOS breach if done enough times. This can be solved other than open models. The same thing happened with stable diffusion. Good thing it's open so you can still use the pre-nerfed 1.6 models. I know it might be edgy or unpopular but I don't think one entity should decide how we can use this powerful tool. No matter its implications and consequences. FOS for the win.
  - staticman2 3y ago
    You should look at the code for Sillytavern. It's capable of prompting GPT 3.5 to take on a character and act like a jerk.
- wordpad25 3y ago
  porn it’s always porn
  - kossTKR 3y ago
    Or literally anything other than the psychotically smarmy tone of GPT-4 that's almost impossible to remove and constantly gives warnings, disclaimers and stops itself if veering even just 1 mm off the most boring status quo perspectives. Lots of my favorite and frankly the best litterature in the world have elements that are obscene, grotesque, bizarre, gritty, erotic, frightening, alternative, provocative - but that's just too much for chat-gpt, instead it has this - in my eyes - way more horrifying smiling-borg-like nature with only two allowed emotions: "ultra happiness", and "ultra obedience to the status quo".
xiphias2 3y ago
It won't matter at all at the end of the year, open source llm's will surpass it by that time.
cubefox 3y ago
Note that code-davinci-002, despite the confusing name, is the actual GPT-3.5 base model, which only does completions and does not have any mode collapse. And it is still available via Azure, as far as I can tell. Text-davinci-003 is a fine-tuned version of it. More info: https://platform.openai.com/docs/model-index-for-researchers https://platform.openai.com/docs/model-index-for-researchers

samstave 3y ago

Please ELI5 if I am mis-interpretating what you said: *"They have just locked down access to a model which they basically realized was way more valuable than even they thought - and they are in the process of locking in all controls around exploiting the model for great justice?"*

H8crilA 3y ago

The $5-$10 is probably the reason why they're killing those endpoints.

superkuh 3y ago
I don't get it? text-davinci-003 is the most expensive model per token. It's just that running IRC bots isn't exactly high volume.
- stavros 3y ago
  "Most expensive" doesn't mean "highest margin", though.
  - H8crilA 3y ago
    I meant that it probably isn't high revenue.

bravura 3y ago

I've never used text-davinci-003 much. Why do you like it so much? What does it offer that the other models don't? What are funs things we can with it until it sunsets on January 4, 2024?

thomasfromcdnjs 3y ago
The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker/builder ethos if they drop things like davinci-003, which might suck for them in the long run. Consumers over developers.
- Fyrezerk 3y ago
  The hacker/builder ethos doesn't matter in the grand scheme of commercialization.
  - Robotbeat 3y ago
    It matters immensely in the early days and is the basis for all growth that follows. So cutting it off early cuts off future growth.
  - kromem 3y ago
    Sure - not like most of the infrastructure of pretty much everything online is built on top of projects originating in that space or anything.
  - RugnirViking 3y ago
    How do they want to commercialise it? Do they want moms to tinker on ChatGPT once a month to do their children's homework? Or do they want people to build businesses using their software

deleted 3y ago

[deleted]

system2 3y ago

I built my entire app on text-davinci-003. It is the best writer so far. Do you think gpt3.5 turbo instruct won't be the same?

raincole 3y ago
> In the coming weeks, we will reach out to developers who have recently used these older models, and will provide more information once the new completion models are ready for early testing. I guess they'll give you early access to it.
- system2 3y ago
  Thanks!

Karrot_Kream 3y ago

I wonder if there's some element of face-saving here to avoid a lawsuit that may come from someone that uses the model to perform negative actions. In general I've found that gpt3.5-turbo is better than text-davinci-003 in most cases, but I agree, it's quite sad that they're getting rid of the unaligned/censored model.

gexla 3y ago
More likely hardware constraints. They can't get the hardware fast enough to do everything they want to do. So, they free up resources by ditching lower demand models.

kromem 3y ago

Yeah, TextCompletion is much better than ChatCompletion with v3 models. But with davinci at the same price point as GPT-4 I'm hoping the latter is enough of a step up in its variety of vocabulary and nudgeable sophistication of language to be a drop in replacement. Though in general I think there's an under appreciation for just how much is being lost in the trend towards instruct models, and hope there will be smart actors in the market who use a pre-optimization step for instruct prompts that formats it for untuned models. I'd imagine that parameter size to parameter size that approach will look much more advanced to end users just by not lobotomizing the underlying model.

gexla 3y ago

My guess is that they would be fine with continuing to serve all models, but that hardware constraints are forcing difficult decisions. SA has already said that hardware is holding them back from what they want to do. I was on a waiting list for the GPT4 API for like a few months, which I guess is because they couldn't keep up with demand.

LeoPanthera 3y ago

Everyone who complains about being "censored" never gives examples.

yard2010 3y ago
I'm trying to create a bot that joins my friends Telegram group and melds into the conversation as if it was a real person. A real person might be the most cute and fun enthusiastic person there is but sometimes it has bad days, or it tells inappropriate jokes, right? People are complicated. Not this bot! No matter what prompt I'm using (with the chat API) it won't lose the happy happy joy joy chatGPT attitude, won't tell inappropriate jokes, won't give advice on certain topics and in general won't talk like a real person, not because of technological limitations.. You can feel it when it's just nerfed. Trying the same prompts that gave nerfed "I am just an AI I can't speculate about the future" bs on completion API gave somewhat better results, but most of the time they were flagged as breaking the guidelines which is a TOS breach if done enough times. This can be solved other than open models. The same thing happened with stable diffusion. Good thing it's open so you can still use the pre-nerfed 1.6 models. I know it might be edgy or unpopular but I don't think one entity should decide how we can use this powerful tool. No matter its implications and consequences. FOS for the win.
- staticman2 3y ago
  You should look at the code for Sillytavern. It's capable of prompting GPT 3.5 to take on a character and act like a jerk.
wordpad25 3y ago
porn it’s always porn
- kossTKR 3y ago
  Or literally anything other than the psychotically smarmy tone of GPT-4 that's almost impossible to remove and constantly gives warnings, disclaimers and stops itself if veering even just 1 mm off the most boring status quo perspectives. Lots of my favorite and frankly the best litterature in the world have elements that are obscene, grotesque, bizarre, gritty, erotic, frightening, alternative, provocative - but that's just too much for chat-gpt, instead it has this - in my eyes - way more horrifying smiling-borg-like nature with only two allowed emotions: "ultra happiness", and "ultra obedience to the status quo".

xiphias2 3y ago

It won't matter at all at the end of the year, open source llm's will surpass it by that time.

cubefox 3y ago

Note that code-davinci-002, despite the confusing name, is the actual GPT-3.5 base model, which only does completions and does not have any mode collapse. And it is still available via Azure, as far as I can tell. Text-davinci-003 is a fine-tuned version of it. More info: https://platform.openai.com/docs/model-index-for-researchers https://platform.openai.com/docs/model-index-for-researchers