3 ms·

I’ve got access to 4 and it’s a huge leap up from 3.5 - much more subtlety in the response, less hallucinations, less hitting a brick wall, but all of it adding

by Closi 4y ago

I’ve got access to 4 and it’s a huge leap up from 3.5 - much more subtlety in the response, less hallucinations, less hitting a brick wall, but all of it adding up to a giant leap.

WXLCKNO 4y ago
It's funny how big the difference feels between 3.5 and 4 but also feels subtle. Like it's just doing what I expect it to versus seeing the limitations more clearly in 3.5.
- novok 4y ago
  It's also an order of magnitude larger in parameter count...
  - buryat 4y ago
    unconfirmed, there’s a theory that it maybe similarly sized as gpt3.5 but with additional RLHF and because of other things it outperforms
    - Closi 4y ago
      Apparently the RLHF actually reduces it's capability, it just improves alignment/safety.
icelancer 4y ago
I agree. I think it depends on the context, though. I still use 3.5-turbo for text generation, content, ideas, etc, where it's completely suitable, fine, and even quite good. However for any coding, complex analysis, or problems requiring calculation, there's no substitute for GPT-4. It blows 3 and 3.5 out of the water for code analysis, generation, debugging, and self-healing.