2 ms·

I agree, GPT-4 has a much more "aggressive" confidence, I definitely noticed that, but I haven't seen much of it since the API is still behind closed doors. I'd

I agree, GPT-4 has a much more "aggressive" confidence, I definitely noticed that, but I haven't seen much of it since the API is still behind closed doors. I'd also like to point out that even though it's better, it still can't reason very well and relies heavily on prompts and instructions, even for very basic projects. It kind of reminds me a pseudo-visual code builder. I was writing a Python script with it to put together documentation summaries, and over the course of an hour it offered me 3 different libraries to connect to an API endpoint I was using. It's distracting.

SketchySeaBeast 4y ago
> GPT-4 has a much more "aggressive" confidence Could you expand on this? I only use the unpaid API, but when I ask for, say, song lyrics, it'll be 100% wrong and then it will give me a second version of the wrong lyrics when I say the first was wrong, and then when I ask how confident it is in the new lyrics it'll say 95%, so whatever the current free API is it's undeservedly confident. I must be misunderstanding what you mean by confidence.
- skilled 4y ago
  I can't really expand because I don't want to share my primary use case, I hope you understand. That said, what I mean is that it feels a lot more comprehensive, as if it really has a grasp on what is being asked, kind of like - its much better at understanding the information it has, so responses feel richer, both in context but also in tone. I am comparing it directly to 3.5. Again, I don't have the API access so I cannot say for sure, this was only my experience from the ChatGPT interface and also a third-party API I spent $20 on just to test its limits, but sadly for the time being those limits are hardcore - it just gets stuck on long responses despite there being a token increase. So, if I really wanted to test it out and make a proper assessment, I'd need access to the API myself so I can do some high-volume token shenanigans.
spookthesunset 4y ago
I’ve had it do stuff like that. In between updates to fix issues sometimes it decides to completely rewrite the thing you are working on.

SketchySeaBeast 4y ago

> GPT-4 has a much more "aggressive" confidence Could you expand on this? I only use the unpaid API, but when I ask for, say, song lyrics, it'll be 100% wrong and then it will give me a second version of the wrong lyrics when I say the first was wrong, and then when I ask how confident it is in the new lyrics it'll say 95%, so whatever the current free API is it's undeservedly confident. I must be misunderstanding what you mean by confidence.

skilled 4y ago
I can't really expand because I don't want to share my primary use case, I hope you understand. That said, what I mean is that it feels a lot more comprehensive, as if it really has a grasp on what is being asked, kind of like - its much better at understanding the information it has, so responses feel richer, both in context but also in tone. I am comparing it directly to 3.5. Again, I don't have the API access so I cannot say for sure, this was only my experience from the ChatGPT interface and also a third-party API I spent $20 on just to test its limits, but sadly for the time being those limits are hardcore - it just gets stuck on long responses despite there being a token increase. So, if I really wanted to test it out and make a proper assessment, I'd need access to the API myself so I can do some high-volume token shenanigans.

spookthesunset 4y ago

I’ve had it do stuff like that. In between updates to fix issues sometimes it decides to completely rewrite the thing you are working on.