2 ms·
> I have a problem, I need to quickly know something that I can verify* if the LLM is feeding me nonsense. Well, in such cases, I use the LLM to speed up my nee
by madeofpalk 3y ago
> I have a problem, I need to quickly know something that I can verify* if the LLM is feeding me nonsense. Well, in such cases, I use the LLM to speed up my need for knowledge.*
This is the key insight from using LLMs in my opinion. One thing that makes programming especially well suited for LLMs is that it's often trivial to verify the correctness.
I've been toying around this concept for evaluating whether a LLM is the right tool for the job. Graph out "how important is it that the output is correct" vs "how easy is it to verify the output is correct". Using ChatGPT to make a list of songs featuring female artists who have won an Emmy is time consuming to verify it's correct, but it's also not very important and it's okay if it contains some errors.
- adamgordonbell 3y agoYeah, exactly. Problems where coming up with solution is hard but verifying a possible solution is easy. And we all know what that class of problems is called.
- blibble 3y ago> One thing that makes programming especially well suited for LLMs is that it's often trivial to verify the correctness. is this why software never has any bugs?
- latexr 3y agoIf something is time consuming, not very important, and accuracy doesn’t matter, perhaps the correct answer is to not do it. The world is already full of irrelevant inaccurate drivel and we’d do well to have less, not accelerate its production. This is not a comment on your specific example, but on the idea as a whole.