2 ms·
I don't think that's the relevant comparison though. Do you expect StackOverflow or product documentation to be 100% accurate 100% of the time? I definitely don
by Analemma_ 1y ago
I don't think that's the relevant comparison though. Do you expect StackOverflow or product documentation to be 100% accurate 100% of the time? I definitely don't.
- ctxc 1y agoThe error introduced by the data is expected and internalized, it's the error of LLMs on _top_ of that that's hard to.
- ctxc 1y agoAlso, documentation and SO are incorrect in a predictable way. We don't expect them to state things in a matter of fact way that just don't exist.
- kweingar 1y agoI actually agree with this. I use LLMs often, and I don't compare them to a calculator. Mainly I meant to push back against the reflexive comparison to a friend or family member or colleague. AI is a multi-purpose tool that is used for many different kinds of tasks. Some of these tasks are analogues to human tasks, where we should anticipate human error. Others are not, and yet we often ask an LLM to do them anyway.