4 ms·

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

by Mizza 4y ago

nonfamous 4y ago
If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-Bing-runs-on-OpenAI%E2%80%99s-GPT-4 https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...
- alchemist1e9 4y ago
  Bing Chat is more useful in many cases because it provides references that connect to it’s responses. I don’t like the mobile UI and that it doesn’t save your chats for you. Maybe I should try the web interface.
- wetpaws 4y ago
  heavily lobotomized version of GPT-4
  - sp332 4y ago
    GPT-4 has a knowledge cutoff from 2001. Bing can talk about current events.
    - stevanl 4y ago
      2021*
    - kervantas 4y ago
      You mean 2021.
simonw 4y ago
Not the API, but if you pay for ChatGPT Plus you can try it out there. It's very, very impressive so far - I've tried a bunch of things I've previously run against GPT-3 and got noticeably better results - maybe not a 2x or 6x multiple in "quality" (depending on how you measure that) but still very clearly improved. Posted a few examples here: https://fedi.simonwillison.net/@simon/110022949941148725 https://fedi.simonwillison.net/@simon/110022949941148725
- Mizza 4y ago
  Thanks for the reply. I'm not all that impressed by "what is"/information retrieval tasks, is it any better at "thought" tasks like explanatory reasoning and ideogensis? For instance - "How might an agoraphobic kleptomaniac satisfy both of their desires simultaneously?"
  - kenjackson 4y ago
    That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?
    - djbusby 4y ago
      Steal from a friends house?
      - sebzim4500 4y ago
        You'd still have to go outside to get to said friends house. I think GPT4 gave the better answer here.
    - Mizza 4y ago
      Ah, interesting! It's a tough question and not one that has an obvious answer, which is what makes it a good test, it requires a little creativity. In my tests, ChatGPT/3 can't/won't answer it.
VWWHFSfQ 4y ago
In my anecodotal experience, GPT-4 is at least a million times better than GPT-3. It's like night and day.
- alchemist1e9 4y ago
  How are you trying it? I’m ChatGPT Plus subscriber but don’t see any change.
  - logical_proof 4y ago
    You should have the option when you start a new chat to use default or 4
    - alchemist1e9 4y ago
      Yes now it gave me that. Not sure why it didn’t before.
- atleastoptimal 4y ago
  In what contexts is the difference the most stark?
caturopath 4y ago
It's difficult to be sure exactly what six times "better" means, but I wouldn't expect something to have to be six times better necessarily to be six times better to be six times more valuable. I wouldn't expect a pitcher making $30MM/yr to be 6x better than one making $5MM/yr, but I could buy that they were 6x more valuable to have on your team.

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

by Mizza 4y ago

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

nonfamous 4y ago

If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-Bing-runs-on-OpenAI%E2%80%99s-GPT-4 https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...

alchemist1e9 4y ago
Bing Chat is more useful in many cases because it provides references that connect to it’s responses. I don’t like the mobile UI and that it doesn’t save your chats for you. Maybe I should try the web interface.
wetpaws 4y ago
heavily lobotomized version of GPT-4
- sp332 4y ago
  GPT-4 has a knowledge cutoff from 2001. Bing can talk about current events.
  - stevanl 4y ago
    2021*
  - kervantas 4y ago
    You mean 2021.

simonw 4y ago

Not the API, but if you pay for ChatGPT Plus you can try it out there. It's very, very impressive so far - I've tried a bunch of things I've previously run against GPT-3 and got noticeably better results - maybe not a 2x or 6x multiple in "quality" (depending on how you measure that) but still very clearly improved. Posted a few examples here: https://fedi.simonwillison.net/@simon/110022949941148725 https://fedi.simonwillison.net/@simon/110022949941148725

Mizza 4y ago
Thanks for the reply. I'm not all that impressed by "what is"/information retrieval tasks, is it any better at "thought" tasks like explanatory reasoning and ideogensis? For instance - "How might an agoraphobic kleptomaniac satisfy both of their desires simultaneously?"
- kenjackson 4y ago
  That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?
  - djbusby 4y ago
    Steal from a friends house?
    - sebzim4500 4y ago
      You'd still have to go outside to get to said friends house. I think GPT4 gave the better answer here.
  - Mizza 4y ago
    Ah, interesting! It's a tough question and not one that has an obvious answer, which is what makes it a good test, it requires a little creativity. In my tests, ChatGPT/3 can't/won't answer it.

VWWHFSfQ 4y ago

In my anecodotal experience, GPT-4 is at least a million times better than GPT-3. It's like night and day.

alchemist1e9 4y ago
How are you trying it? I’m ChatGPT Plus subscriber but don’t see any change.
- logical_proof 4y ago
  You should have the option when you start a new chat to use default or 4
  - alchemist1e9 4y ago
    Yes now it gave me that. Not sure why it didn’t before.
atleastoptimal 4y ago
In what contexts is the difference the most stark?

caturopath 4y ago

It's difficult to be sure exactly what six times "better" means, but I wouldn't expect something to have to be six times better necessarily to be six times better to be six times more valuable. I wouldn't expect a pitcher making $30MM/yr to be 6x better than one making $5MM/yr, but I could buy that they were 6x more valuable to have on your team.