2 ms·
That's quite a leap there from "sometimes wrong" to "basically useless"...
by crazygringo 2y ago
That's quite a leap there from "sometimes wrong" to "basically useless"...
- WhyNotHugo 2y agoIf a model often produces information that is blatantly wrong, then you need to check ALL of its outputs. If you're going to have to double-check all information that it provides, you might as well skip using it entirely and search for the information directly.
- nolist_policy 2y agoLLMs produce wrong results. News at 11.
- crazygringo 2y agoYou're missing the part where searching for the information directly might take hours or even days. You're looking for black-and-white truth, while the real world is actually more interested in efficiency. I can spend 2 days scouring documentation and forum posts and experimenting to get ffmpeg or Matplotlib to produce exactly the results I want. Or I can just ask ChatGPT and check if its code works, and if it doesn't maybe spend 10 minutes correcting it so it does, or refining the prompt so it does. And so you're also missing the part where verifying the correctness of output is very often many orders of magnitude faster than coming up with the output in the first place.
- rdtsc 2y ago> quite a leap there A healthy hop I would say, keeping in mind that this was showing off the best side of it in a commercial. So it just did a Google search, got a wrong factual result, the LLM couldn’t verify it was bogus, regurgitated it as is, and the executive piped in with “acshually, it’s just a plain old search result” somehow not realizing that just makes them look even worse.