3 ms·
Well, the prompt says it all, fictional, simulate... No surprise that it "made things up". What I find more concerning is that it keeps making things up in ra
by lynx23 4y ago
Well, the prompt says it all, fictional, simulate... No surprise that it "made things up". What I find more concerning is that it keeps making things up in rather concrete questions. I tried its map-reading capabilities today, asking it in what part of my town a certain street is, and what well-known things are nearby. It came up with a confidently-sounding answer. But without looking at a map, I immediately knew one of supposedly near-by things were actually on the other side of the town. So I let it know that I thought it was wrong. It appologized, and mentioned another near-by which was also wrong. Corrected it again, and it appologized again. At least it didnt make up something impossible the third time around... However, the confidence it implies combined with a high rate of hallucinations is quite worrying.
I am slowly coming to the conclusion that everything it tells you which you dont already know, is highly likely to be wrong. Question is, how useful it actually is, given that failure rate.
It feels like a person that really likes to talk, and has no regard for truth. If you catch an acquaintance of yours deliberately making things up just to sound eloquent, you'd put em into a "dont trust with anything"-category pretty quickly.
- djtango 4y agoSounds a lot like gellman amnesia. And we know by the readership of the news that most people discount GA
- moonchrome 4y ago>I am slowly coming to the conclusion that everything it tells you which you dont already know, is highly likely to be wrong It can also be wrong about the things you already know. My rule of thumb is if the cost of generation + verification + estimated correction time is higher than cost of doing it your self - avoid AI. So if you have stuff where you already know what needs to be done depending on how well it fits in the AI tool workflow, it might be a good choice. If not just don't bother.
- fireflash38 4y ago> My rule of thumb is if the cost of generation + verification + estimated correction time is higher than cost of doing it your self - avoid AI. Amusingly enough, this is the exact strategy you should use for outsourcing development too.