5 ms·
That's the thing - I can't trust ChatGPT. If I am searching for something I don't know the answer to and don't have the luxury of trial-and-error for the info
by rockskon 2y ago
That's the thing -
I can't trust ChatGPT.
If I am searching for something I don't know the answer to and don't have the luxury of trial-and-error for the information I'm given, I can't rely on an unreliable agent like ChatGPT (or literally any LLM for that matter).
ChatGPT could be giving me a correct answer. Or it could be blowing smoke up my ass.
I don't know which it is when I'm seeing an answer from ChatGPT!
And that's the problem.
- tasuki 2y agoAsk questions where you can verify whether the answer is correct. Then it becomes a very useful tool.
- rockskon 2y agoOnly if the trial-and-error process has no meaningful consequences for failure.
- tasuki 2y agoWhat things do you work on that have meaningful consequences for failure? Woodworking? LLMs indeed might not be for you! I write code and there's zero consequences for failure as long as I don't push it in version control...
- School-Cotton 2y agoYeah. Which describes tons of stuff I encounter every day.
- rockskon 2y agoWhich doesn't describe much of my stuff at all. At least not my stuff where it'd be quicker to ask an AI agent for help with.
- latexr 2y ago> Ask questions where you can verify whether the answer is correct. If you’re going to verify (and you should), might as well skip the asking step.
- hn_throwaway_99 2y agoExcept that's a million times slower. I'll often ask it to generate some complicated SQL queries for me (usually when I need to get info from system tables, less so my own data), and it's pretty trivially easy to verify the output. It would take me much, much longer if I had to write these queries from scratch.
- School-Cotton 2y agoThere are lots of things that are easier to verify than to figure out how to do from scratch.