4 ms·

Why is it always the same reply? Yes, GPT4 is as useless as GPT3.5 on any non trivial task.

by andrepd 3y ago

input_sh 3y ago
My guess is people feel the need to self-justify their $20/month subscription.
- aenis 3y ago
  My guess is most people into AI don't even remember that they are paying a $20/month for this. We do a lot of experiments involving gpt3.5, 4, claude-v2, titan-large, and palm2, and for what it's worth, on our real production workloads gpt4 shines. We can make Palm2 produce decent results with a lot of extra effort, and claude-v2 is passable but gpt4 does not disappoint. This is low-grade knowledge management stuff, and we are not using it as a information-retrieval system - but for basic 'cognitive' tasks where all the information needed is provided in the prompt. I'd not rely on it for info retrieval tasks such as the examples quoted above - its knowledge base is highly compressed, after all.
Kiro 3y ago
> Why is it always the same reply? When there's one definitive answer to something that people keep repeating there's a slight chance that it's actually true. Shocking, I know.
- andrepd 3y ago
  Well but it's not. Also, your reasoning would imply e.g. Qanon is true based on the number of people repeating the same thing, so that's pretty weak.
  - jstummbillig 3y ago
    Well. You would definitely have to very carefully select a very, VERY narrow slice of society, to get a piece where Qanon supporters make up a significant percentage of people. But hey, if you are really looking to convince yourself of something, I have no doubt that it can be done.
dontupvoteme 3y ago
The WebUI was definitely nerfed but the API still seems ok.
sebzim4500 3y ago
>Why is it always the same reply? I keep going around telling people that 1+1=3, why do they always give me the same nonsense about the number '2'? I blame Sam Altman.
- andrepd 3y ago
  ?
  - Kiro 3y ago
    The point is that people keep repeating it because it's true. Why are you being so obnoxious about it? Anyone who has used GPT-3.5 vs GPT-4 knows this and it's just ridiculous to claim otherwise.
    - andrepd 3y ago
      1. I've used it, and I don't think so. 2. Obnoxious? This is my opinion, I don't get what Sam Altman or 1+1=3 is supposed to mean in this context.

Why is it always the same reply? Yes, GPT4 is as useless as GPT3.5 on any non trivial task.

input_sh 3y ago

My guess is people feel the need to self-justify their $20/month subscription.

aenis 3y ago
My guess is most people into AI don't even remember that they are paying a $20/month for this. We do a lot of experiments involving gpt3.5, 4, claude-v2, titan-large, and palm2, and for what it's worth, on our real production workloads gpt4 shines. We can make Palm2 produce decent results with a lot of extra effort, and claude-v2 is passable but gpt4 does not disappoint. This is low-grade knowledge management stuff, and we are not using it as a information-retrieval system - but for basic 'cognitive' tasks where all the information needed is provided in the prompt. I'd not rely on it for info retrieval tasks such as the examples quoted above - its knowledge base is highly compressed, after all.

Kiro 3y ago

> Why is it always the same reply? When there's one definitive answer to something that people keep repeating there's a slight chance that it's actually true. Shocking, I know.

andrepd 3y ago
Well but it's not. Also, your reasoning would imply e.g. Qanon is true based on the number of people repeating the same thing, so that's pretty weak.
- jstummbillig 3y ago
  Well. You would definitely have to very carefully select a very, VERY narrow slice of society, to get a piece where Qanon supporters make up a significant percentage of people. But hey, if you are really looking to convince yourself of something, I have no doubt that it can be done.

dontupvoteme 3y ago

The WebUI was definitely nerfed but the API still seems ok.

sebzim4500 3y ago

>Why is it always the same reply? I keep going around telling people that 1+1=3, why do they always give me the same nonsense about the number '2'? I blame Sam Altman.

andrepd 3y ago
?
- Kiro 3y ago
  The point is that people keep repeating it because it's true. Why are you being so obnoxious about it? Anyone who has used GPT-3.5 vs GPT-4 knows this and it's just ridiculous to claim otherwise.
  - andrepd 3y ago
    1. I've used it, and I don't think so. 2. Obnoxious? This is my opinion, I don't get what Sam Altman or 1+1=3 is supposed to mean in this context.