4 ms·

ChatGPT, when I was forced to use it often got confused which is the bigger number, 2 or 3. I don't care how many lines of bottom of the barrel code it can thro

by jgb1984 2y ago

ChatGPT, when I was forced to use it often got confused which is the bigger number, 2 or 3. I don't care how many lines of bottom of the barrel code it can throw up, I'm not using any of it. AI generated spaghetti debt. LLM's will turn out to be nothing more than another glittering gadget. Except this one will obliterate any coding skills of future generations. Not to mention the gigatons of AI generated garbage text, images and music that it's filling the world with. What a waste.

groby_b 2y ago
You... might want to inform yourself a bit more before making proclamations about the future. LLMs have fairly well understood failure modes. They have incredible strengths, too. And they differ very much by what you use. If the ChatGPT you were forced to use was GPT3.5 (and the behavior sounds very much like it was), you literally have no idea what modern LLMs can actually do.
superfrank 2y ago
> ChatGPT, when I was forced to use it often got confused which is the bigger number, 2 or 3 I mean... yeah. ChatGPT doesn't know what numbers or what logic is. It wasn't "confused". It just doesn't do that. You're using it for something it's not intended to be used for and, unsurprisingly, it's bad at it. If I said I'm giving up on using hammers because they were terrible for screwing screws into the wall, you'd tell me I'm using the wrong tool. This is no different. ChatGPT has its uses, but it isn't magic. Just like any tool it has limitations.
sdenton4 2y ago
User: which is the larger number, 3 or 2? ChatGPT: The larger number is 3. User: If I have one apple, pick another apple and then get an apple from a friend, and Alice has two apples, who has more apples? ChatGPT: You have more apples. You started with one apple, picked another, and got one more from a friend, so you have three apples. Alice has two apples. [edit]: User: what does good will hunting say to the know-it-all at the bar? ChatGPT: After Will Hunting outsmarts the know-it-all student in the bar, he spots the student's female friend outside a shop later on. To tease the student further and show his wit, Will taps on the window to get her attention and, holding up his phone number, famously asks, "Do you like apples?" After she nods, Will triumphantly says, "Well, I got her number. How do you like them apples?" This line became quite iconic and is one of the memorable quotes from the movie.
- Jensson 2y ago
  Since ChatGPT doesn't have a central place to do math its ability to know whether 3 is bigger than 2 depends on the context, your examples thus doesn't prove anything. Every time I've tried gpt-4 etc there are such problems. I don't use it for trivial things since then what's the point, and for anything non-trivial it screws up too much. It is useful for translations and brainstorming, but not much else. Translating from natural language to code is a part of that, but not letting it code itself.
cvhashim04 2y ago
I think you're in for a rude awakening. The software engineering field will be an unrecognizable landscape 5-10 years from now and you'll be looked at like the guy who codes in text edit with no ide if you arent using some form of an AI to generate code -- notice I said generate, coding from scratch will be a thing of the past also.
- jgb1984 2y ago
  That's incredibly funny, since I've been developing software for 20+ years using debian and vim (look mom, no IDE!) and I'm pretty sure that's what I'll be doing for the years to come. Imagine how valuable it will be when you're in the minority of humans who still understand how a linux system operates, and how to write and read your own code! Amazing! I absolutely welcome cloud and AI, happy to let it destroy any and all wisdom of future generations :)

groby_b 2y ago

You... might want to inform yourself a bit more before making proclamations about the future. LLMs have fairly well understood failure modes. They have incredible strengths, too. And they differ very much by what you use. If the ChatGPT you were forced to use was GPT3.5 (and the behavior sounds very much like it was), you literally have no idea what modern LLMs can actually do.

superfrank 2y ago

> ChatGPT, when I was forced to use it often got confused which is the bigger number, 2 or 3 I mean... yeah. ChatGPT doesn't know what numbers or what logic is. It wasn't "confused". It just doesn't do that. You're using it for something it's not intended to be used for and, unsurprisingly, it's bad at it. If I said I'm giving up on using hammers because they were terrible for screwing screws into the wall, you'd tell me I'm using the wrong tool. This is no different. ChatGPT has its uses, but it isn't magic. Just like any tool it has limitations.

sdenton4 2y ago

User: which is the larger number, 3 or 2? ChatGPT: The larger number is 3. User: If I have one apple, pick another apple and then get an apple from a friend, and Alice has two apples, who has more apples? ChatGPT: You have more apples. You started with one apple, picked another, and got one more from a friend, so you have three apples. Alice has two apples. [edit]: User: what does good will hunting say to the know-it-all at the bar? ChatGPT: After Will Hunting outsmarts the know-it-all student in the bar, he spots the student's female friend outside a shop later on. To tease the student further and show his wit, Will taps on the window to get her attention and, holding up his phone number, famously asks, "Do you like apples?" After she nods, Will triumphantly says, "Well, I got her number. How do you like them apples?" This line became quite iconic and is one of the memorable quotes from the movie.

Jensson 2y ago
Since ChatGPT doesn't have a central place to do math its ability to know whether 3 is bigger than 2 depends on the context, your examples thus doesn't prove anything. Every time I've tried gpt-4 etc there are such problems. I don't use it for trivial things since then what's the point, and for anything non-trivial it screws up too much. It is useful for translations and brainstorming, but not much else. Translating from natural language to code is a part of that, but not letting it code itself.

cvhashim04 2y ago

I think you're in for a rude awakening. The software engineering field will be an unrecognizable landscape 5-10 years from now and you'll be looked at like the guy who codes in text edit with no ide if you arent using some form of an AI to generate code -- notice I said generate, coding from scratch will be a thing of the past also.

jgb1984 2y ago
That's incredibly funny, since I've been developing software for 20+ years using debian and vim (look mom, no IDE!) and I'm pretty sure that's what I'll be doing for the years to come. Imagine how valuable it will be when you're in the minority of humans who still understand how a linux system operates, and how to write and read your own code! Amazing! I absolutely welcome cloud and AI, happy to let it destroy any and all wisdom of future generations :)