3 ms·
But here's what happens when I try that : Me : I don't understand this publicly documented AWS service with plenty of OSS examples, can you suggest how I wou
by moonchrome 4y ago
But here's what happens when I try that :
Me : I don't understand this publicly documented AWS service with plenty of OSS examples, can you suggest how I would solve some edge case X
GPT : Oh that's easy, invents bullshit that sounds exactly like what I need
Me : Googles the shit the GPT came up with and can't find any references
Me : Maybe there is something similar - spends more time searching
Me : GPT you're wrong - your solution doesn't exist
GPT : Oh sorry, here's the correct solution, comes up with more bulshit
Me : Googles the shit that GPT came up with and can't find any references
Me : Starts googling and solving the problem on my own
Me : Finds out X can't be done with AWS service
I've had this flow many times now, it never resulted in valuable output from GPT vs just Googling since I need to verify everything anyway.
Or
Me : Review and come up with improvements to this code : CP code
GPT : Suggest bullshit improvements, gives factually wrong reasoning, makes code worse
Me : Points out everything wrong
GPT : Suggest other bullshit improvements
Me : Points out everything wrong
GPT : Returns basically identical code to input
Or
Me : Propose a design to this technical problem
GPT : Implements the solution in the most roundabout way and suboptimal way
IMO if I'm not sure what the output should be GPT is less than worthless it's actually convincingly misleading.
- Toutouxc 4y agoIs that with 3.5 or with 4? 4 is usually not afraid to tell it doesn’t know.
- moonchrome 4y agoI've upgraded to 4 ASAP, all those examples are with 4. I tried 3.5 buy it was completely useless, 4 actually started giving sane output but still lying and hard to verify. My only use case so far is stuff like "translate this model to openapi schema" because it was faster than setting up the tool, and similar tasks that are easy to verify and boring to type.