6 ms·

This is one hell of a loss leader to keep people from using competitors, especially since it appears that it’s not being used to upsell to a paid offering. Thi

This is one hell of a loss leader to keep people from using competitors, especially since it appears that it’s not being used to upsell to a paid offering. This can’t be sustainable even with all the inference optimizations in the world.

toomuchtodo 3y ago
> We may use what you provide to ChatGPT to improve our models for everyone. I believe OpenAI has elected to eat the compute cost in order to teach the model faster to stay ahead of competitors. How much are you willing to pay as the robot gets better faster? Everyone fighting over steepness of the hockey stick trajectory. Anyone can buy GPUs, you can’t buy human attribution training. You need human prompt and response cycle for that.
- moralestapia 3y ago
  I agree, GPT-4 is still the undisputed king in LLMs, it's been a wee bit more than a year since it came out. I'm sure that the quality of GPT-5 will depend more on a carefully curated training set than just an increase in their dataset size, and I think they're really good at that. Also, very few people know as much as sama about making startups grow, so ... PS. I'm not even a fan of "Open"AI, but it is what it is.
  - moffkalast 3y ago
    It's more of a disputed king these days, lots of benchmarks show Claude Opus ahead and a fair few people do prefer it.
    - happypumpkin 3y ago
      Yup, Claude is my go-to now. Both models seem equally "intelligent" but Claude has a better sense of when to be terse or verbose + the responses seem more natural. I still use GPT4 when I need code executed as Anthropic hasn't implemented that yet (though this "feature" can be annoying as some prompts to the GPT4 web interface result in code being executed when I just wanted it to be displayed).
    - jiriro 3y ago
      No joy:-( Unfortunately, Claude.ai is only available in certain regions right now. We're working hard to expand to other regions soon.
      - dontupvoteme 3y ago
        ironically the API is available most everywhere, and it has an ok-ish web interface (they're really heavy on prompt engineering it seems though)
djangogitit 3y ago
[dead]
declaredapple 3y ago
It's going to be GPT-3.5turbo not GPT4. As others have mentioned, binggpt/bard are also free. These smaller models are a relatively cheap to run, especially in high batches. I'm sure there will also be aggressive rate limits.
observationist 3y ago
If the value of user interactions exceeds the cost of compute, then this is an easy decision. They apparently constrained this publicly available version, with no gpt-4 or dall-e, and a more limited range of topics and uses than if you sign up. They do explicitly recommend upgrading: We’ve also introduced additional content safeguards for this experience, such as blocking prompts and generations in a wider range of categories. There are many benefits to creating an account including the ability to save and review your chat history, share chats, and unlock additional features like voice conversations and custom instructions. For anyone that has been curious about AI’s potential but didn’t want to go through the steps to set-up an account, start using ChatGPT today.
HarHarVeryFunny 3y ago
I think OpenAI are running scared of Anthropic (who are moving way faster than they are). The last half dozen things they have said all seem to point to this. "New model coming soonish" (Sure, so where is it?) "GPT-4 kind of sucks" (Altman seemed to like it better before Athropic beat it) "[To Lex Fridman:] We don't want our next model to be shockingly good" (Really ?) "Microsoft/OpenAI building $100B StarGate supercomputer" (Convenient timing for rumor, after Anthopic's partner Amazon already announced $100B+ plans) "ChatGPT is free" (Thanks Claude!)
- epups 3y ago
  How is Anthropic moving so fast if it took them almost a year to produce a better model? And they have probably 1% of the market right now.
  - HarHarVeryFunny 3y ago
    Anthropic as a company only was created after GPT-3 (Dario Amodei's name is even on the GPT-3 paper). So, in same time OpenAI have gone from GPT-3 to GPT-4, Anthropic have gone from startup to Claude-1 to Claude-2 to Claude-3 which beats GPT-4 ! It's not just Anthropic having three releases in time it took OpenAI to have one, but also that they did so from a standing start in terms of developers, infrastructure, training data, etc. OpenAI had everything in place as they continued from GPT-3 to GPT-4.
    - wavemode 3y ago
      I had a funny thought when Anthropic was still a new startup. I was browsing their careers page and noticed: 1. They state upfront the salary expectations for all their positions 2. The salaries offered are quite high and I immediately decided this was probably the company to bet on, just by virtue of them probably being able to attract and retain the best talent, and thus engineer the best product. I contrasted it with so many startups I've seen and worked at that try their damnedest to underpay everyone, thus their engineers were mediocre and their product was built like trash.
smikesix 3y ago
they regulary and often downgrade their gpts. gpt4 now is about as good as gpt3.5 was in the beginning. like 6-7 months ago there was a gpt4 version that was really good, it could understand context and stuff extremly well, but it just went downhill from there. i wont pay for current chatgpt 4 anymore
- happypumpkin 3y ago
  While I agree that GPT4 (in the web app) is not as good as it used to be, I don't think it is anywhere near GPT3.5 level. There are many things web app GPT4 can do that GPT3.5 couldn't do at ChatGPT's release (or now afaik).
- shostack 3y ago
  One thing I really dislike about hosted models is how opaque that behavior is. As a user I should never be guessing if they've reduced a model's capabilities to save on compute for example. This is why I'm excited for the growth of local model capabilities. I can much more reasonably expect that the model has not degraded and that it is using the full hardware capabilities it has been granted.
jacooper 3y ago
Bing/Copilot works without an account too, it's just very limited and it will ask you to sign in way too often for it to be useful, openai will probably do the same thing.

toomuchtodo 3y ago

> We may use what you provide to ChatGPT to improve our models for everyone. I believe OpenAI has elected to eat the compute cost in order to teach the model faster to stay ahead of competitors. How much are you willing to pay as the robot gets better faster? Everyone fighting over steepness of the hockey stick trajectory. Anyone can buy GPUs, you can’t buy human attribution training. You need human prompt and response cycle for that.

moralestapia 3y ago
I agree, GPT-4 is still the undisputed king in LLMs, it's been a wee bit more than a year since it came out. I'm sure that the quality of GPT-5 will depend more on a carefully curated training set than just an increase in their dataset size, and I think they're really good at that. Also, very few people know as much as sama about making startups grow, so ... PS. I'm not even a fan of "Open"AI, but it is what it is.
- moffkalast 3y ago
  It's more of a disputed king these days, lots of benchmarks show Claude Opus ahead and a fair few people do prefer it.
  - happypumpkin 3y ago
    Yup, Claude is my go-to now. Both models seem equally "intelligent" but Claude has a better sense of when to be terse or verbose + the responses seem more natural. I still use GPT4 when I need code executed as Anthropic hasn't implemented that yet (though this "feature" can be annoying as some prompts to the GPT4 web interface result in code being executed when I just wanted it to be displayed).
  - jiriro 3y ago
    No joy:-( Unfortunately, Claude.ai is only available in certain regions right now. We're working hard to expand to other regions soon.
    - dontupvoteme 3y ago
      ironically the API is available most everywhere, and it has an ok-ish web interface (they're really heavy on prompt engineering it seems though)

djangogitit 3y ago

[dead]

declaredapple 3y ago

It's going to be GPT-3.5turbo not GPT4. As others have mentioned, binggpt/bard are also free. These smaller models are a relatively cheap to run, especially in high batches. I'm sure there will also be aggressive rate limits.

observationist 3y ago

If the value of user interactions exceeds the cost of compute, then this is an easy decision. They apparently constrained this publicly available version, with no gpt-4 or dall-e, and a more limited range of topics and uses than if you sign up. They do explicitly recommend upgrading: We’ve also introduced additional content safeguards for this experience, such as blocking prompts and generations in a wider range of categories. There are many benefits to creating an account including the ability to save and review your chat history, share chats, and unlock additional features like voice conversations and custom instructions. For anyone that has been curious about AI’s potential but didn’t want to go through the steps to set-up an account, start using ChatGPT today.

HarHarVeryFunny 3y ago

I think OpenAI are running scared of Anthropic (who are moving way faster than they are). The last half dozen things they have said all seem to point to this. "New model coming soonish" (Sure, so where is it?) "GPT-4 kind of sucks" (Altman seemed to like it better before Athropic beat it) "[To Lex Fridman:] We don't want our next model to be shockingly good" (Really ?) "Microsoft/OpenAI building $100B StarGate supercomputer" (Convenient timing for rumor, after Anthopic's partner Amazon already announced $100B+ plans) "ChatGPT is free" (Thanks Claude!)

epups 3y ago
How is Anthropic moving so fast if it took them almost a year to produce a better model? And they have probably 1% of the market right now.
- HarHarVeryFunny 3y ago
  Anthropic as a company only was created after GPT-3 (Dario Amodei's name is even on the GPT-3 paper). So, in same time OpenAI have gone from GPT-3 to GPT-4, Anthropic have gone from startup to Claude-1 to Claude-2 to Claude-3 which beats GPT-4 ! It's not just Anthropic having three releases in time it took OpenAI to have one, but also that they did so from a standing start in terms of developers, infrastructure, training data, etc. OpenAI had everything in place as they continued from GPT-3 to GPT-4.
  - wavemode 3y ago
    I had a funny thought when Anthropic was still a new startup. I was browsing their careers page and noticed: 1. They state upfront the salary expectations for all their positions 2. The salaries offered are quite high and I immediately decided this was probably the company to bet on, just by virtue of them probably being able to attract and retain the best talent, and thus engineer the best product. I contrasted it with so many startups I've seen and worked at that try their damnedest to underpay everyone, thus their engineers were mediocre and their product was built like trash.

smikesix 3y ago

they regulary and often downgrade their gpts. gpt4 now is about as good as gpt3.5 was in the beginning. like 6-7 months ago there was a gpt4 version that was really good, it could understand context and stuff extremly well, but it just went downhill from there. i wont pay for current chatgpt 4 anymore

happypumpkin 3y ago
While I agree that GPT4 (in the web app) is not as good as it used to be, I don't think it is anywhere near GPT3.5 level. There are many things web app GPT4 can do that GPT3.5 couldn't do at ChatGPT's release (or now afaik).
shostack 3y ago
One thing I really dislike about hosted models is how opaque that behavior is. As a user I should never be guessing if they've reduced a model's capabilities to save on compute for example. This is why I'm excited for the growth of local model capabilities. I can much more reasonably expect that the model has not degraded and that it is using the full hardware capabilities it has been granted.

jacooper 3y ago

Bing/Copilot works without an account too, it's just very limited and it will ask you to sign in way too often for it to be useful, openai will probably do the same thing.