5 ms·

I'd like to echo the GPT-4 sentiment. Having used the API a bunch, the ChatGPT API (GPT-3.5-Turbo) feels like it has a 10-second attention span in comparison t

I'd like to echo the GPT-4 sentiment. Having used the API a bunch, the ChatGPT API (GPT-3.5-Turbo) feels like it has a 10-second attention span in comparison to GPT-4. GPT-4 is waaaay more powerful for actually building stuff on top of, adheres to your prompt in a much more stable way, and its reasoning is way less unstable in general as well. Writing long blocks of code without making "stupid" mistakes works much much better, etc. The only downside is: it's so, so, soooooo slow in comparison to GPT-3.5-Turbo. You'll literally have to wait 2-3 minutes for the response with larger token amounts.

throwuwu 4y ago
Thinking fast, thinking slow
sho_hn 4y ago
I find both your statements confusing and I think they're factually wrong. There's no "ChatGPT API". ChatGPT is a webapp. It lets you select between 3.5-turbo and 4 models in its UI. There's an OpenAI API, which recently added chat interactions and suitable models. There, too, you can select 3.5-turbo and 4. AFAIK, the 4 served by the API is the same 4 used by the ChatGPT web app.
- growthwtf 4y ago
  You may have missed the intro blog post for those APIs: https://openai.com/blog/introducing-chatgpt-and-whisper-apis https://openai.com/blog/introducing-chatgpt-and-whisper-apis The title is "Introducing ChatGPT and Whisper APIs" and features quotes like "Snap Inc., the creator of Snapchat, introduced My AI for Snapchat+ this week. The experimental feature is running on ChatGPT API". So, OpenAI refers to accessing the model powering ChatGPT as the ChatGPT API.
  - sho_hn 4y ago
    OK, gotcha. Still, IMHO the OP post is misleading folks into thinking there's a magical GPT-4 that is not the GPT-4 you can also select on ChatGPT, but they are the same models. There's no GPT-4 that's better than ChatGPT's 4. I'm just trying to clear up this confusion for others, and frankly pretty surprised at the harsh downvotes. There's also no separate ChatGPT API from the regular OpenAI API, I think the phrasing in the OpenAI page is just for convenience. But I'll grant their phrasing makes it canonical.
    - growthwtf 4y ago
      I see where you're coming from. I didn't personally get that from OP's comment, but I'm not a regular ChatGPT user and interact with GPT-4 mostly via playground or API.
    - saurik 4y ago
      Is that true? I was under the impression it was just like with the previous GPT models, where ChatGPT was an instruction tuned and pre-prompted setup designed for interactive conversations over the underlying GPT model you had access to via the API that was in its close-to-as-trained state of being a generative autocomplete.
      - sho_hn 4y ago
        I think it's true. See e.g. https://openai.com/research/gpt-4 https://openai.com/research/gpt-4 making no distinctions. Altman has stated in interviews they are considering releasing the un-tuned "base model", but they haven't done this. For GPT-3, you can get models on the API via the "completion" end points (includes base models) and via the "chat" endpoints. For GPT-4, they've only released the latter. So my point is: You can absolutely use ChatGPT to build an opinion on what GPT-4 is capable of. Arguably even better than on the Playground, as the ChatGPT frontend supports a bigger token window than the Playground frontend (8k vs. 2k). Of course the actual API supports the full token window (and if you're off the separate waitlist for this, even the full 32k). But it's still the same model.
    - nomel 4y ago
      There is a more "pure" GPT-4 model, and they're considering giving access to it. It's just not as useful to humans. Sam Altman talks about it briefly in the recent interview on the Lex Fridman podcast.
      - sho_hn 4y ago
        Yes, I know, but this is presently not available via the API. What OP here means is that someone's talking about 3.5 without having tried something with 4, while accidentally misleading people into thinking that there's a special 4 distinct from the 4 available on ChatGPT that can do more. This is not the case. If you've used 4 via GPT, there's not a different version somehow - that we know about! - that is more capable or useful. If your interactions with 4 were via the ChatGPT frontend, you don't need to revisit your opinions now.
- pmichaud 4y ago
  It's called the ChatGPT API by OpenAI, and free users (ie almost everyone using the system) can only use GPT-3.5. There is no option for them to use GPT-4, which is behind a paywall and a waitlist (maybe the waitlist is done now, I haven't checked).
moonchrome 4y ago
Is ChatGPT GPT4 equivalent to API version ?

throwuwu 4y ago

Thinking fast, thinking slow

sho_hn 4y ago

I find both your statements confusing and I think they're factually wrong. There's no "ChatGPT API". ChatGPT is a webapp. It lets you select between 3.5-turbo and 4 models in its UI. There's an OpenAI API, which recently added chat interactions and suitable models. There, too, you can select 3.5-turbo and 4. AFAIK, the 4 served by the API is the same 4 used by the ChatGPT web app.

growthwtf 4y ago
You may have missed the intro blog post for those APIs: https://openai.com/blog/introducing-chatgpt-and-whisper-apis https://openai.com/blog/introducing-chatgpt-and-whisper-apis The title is "Introducing ChatGPT and Whisper APIs" and features quotes like "Snap Inc., the creator of Snapchat, introduced My AI for Snapchat+ this week. The experimental feature is running on ChatGPT API". So, OpenAI refers to accessing the model powering ChatGPT as the ChatGPT API.
- sho_hn 4y ago
  OK, gotcha. Still, IMHO the OP post is misleading folks into thinking there's a magical GPT-4 that is not the GPT-4 you can also select on ChatGPT, but they are the same models. There's no GPT-4 that's better than ChatGPT's 4. I'm just trying to clear up this confusion for others, and frankly pretty surprised at the harsh downvotes. There's also no separate ChatGPT API from the regular OpenAI API, I think the phrasing in the OpenAI page is just for convenience. But I'll grant their phrasing makes it canonical.
  - growthwtf 4y ago
    I see where you're coming from. I didn't personally get that from OP's comment, but I'm not a regular ChatGPT user and interact with GPT-4 mostly via playground or API.
  - saurik 4y ago
    Is that true? I was under the impression it was just like with the previous GPT models, where ChatGPT was an instruction tuned and pre-prompted setup designed for interactive conversations over the underlying GPT model you had access to via the API that was in its close-to-as-trained state of being a generative autocomplete.
    - sho_hn 4y ago
      I think it's true. See e.g. https://openai.com/research/gpt-4 https://openai.com/research/gpt-4 making no distinctions. Altman has stated in interviews they are considering releasing the un-tuned "base model", but they haven't done this. For GPT-3, you can get models on the API via the "completion" end points (includes base models) and via the "chat" endpoints. For GPT-4, they've only released the latter. So my point is: You can absolutely use ChatGPT to build an opinion on what GPT-4 is capable of. Arguably even better than on the Playground, as the ChatGPT frontend supports a bigger token window than the Playground frontend (8k vs. 2k). Of course the actual API supports the full token window (and if you're off the separate waitlist for this, even the full 32k). But it's still the same model.
  - nomel 4y ago
    There is a more "pure" GPT-4 model, and they're considering giving access to it. It's just not as useful to humans. Sam Altman talks about it briefly in the recent interview on the Lex Fridman podcast.
    - sho_hn 4y ago
      Yes, I know, but this is presently not available via the API. What OP here means is that someone's talking about 3.5 without having tried something with 4, while accidentally misleading people into thinking that there's a special 4 distinct from the 4 available on ChatGPT that can do more. This is not the case. If you've used 4 via GPT, there's not a different version somehow - that we know about! - that is more capable or useful. If your interactions with 4 were via the ChatGPT frontend, you don't need to revisit your opinions now.
pmichaud 4y ago
It's called the ChatGPT API by OpenAI, and free users (ie almost everyone using the system) can only use GPT-3.5. There is no option for them to use GPT-4, which is behind a paywall and a waitlist (maybe the waitlist is done now, I haven't checked).

moonchrome 4y ago

Is ChatGPT GPT4 equivalent to API version ?