3 ms·

LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment. Heck, one of the things you have to judge is how accurat

LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment. Heck, one of the things you have to judge is how accurate the answer is. The LLM can't assess that - as you note it has unfailing confidence in reporting the wrong information. What I have found, and I've been using Bard over ChatGPT because Bard seems to be a bit smarter at first glance, is these tools are powerful but limited. They can augment a workforce but only a fool, soon to go out of business, would use them to replace a workforce.

NovaDudely 3y ago
This is just it, I don't fear LLM's - that are a really cool technology that once you understand their utility are really cool. I fear how others will use them not understanding their limitations.
not2b 3y ago
Except that search engine providers used to think they were in the business of providing accurate, quality information in exchange for ad revenue (before they took one step after another to degrade this in pursuit of revenue growth). People judge how accurate an answer is by doing searches, hoping to find reputable information to check an assertion. If all they can find is confident-sounding crap, how good is their judgment going to be?
astrange 3y ago
Bard is much less capable than GPT4, if you're only using the free tier. What I notice about Bard is that it hallucinates almost anytime I ask it anything. "Compare and contrast <two things that don't exist>" is a good one.
tyre 3y ago
> one of the things you have to judge is how accurate the answer is. The LLM can't assess that Not quite true. Some LLMs are surprisingly good at predicting their confidence in answers (where a series of 80% confidence output should end up being right 80% of the time.) “Language Models (Mostly) Know What They Know” by Anthropic: https://www.anthropic.com/index/language-models-mostly-know-what-they-know https://www.anthropic.com/index/language-models-mostly-know-...
avgcorrection 3y ago
> LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment. There is an adage—and there are many variations—that says something like: a falsehood can travel half-way across the world before the truth has time to put on its boots.

NovaDudely 3y ago

This is just it, I don't fear LLM's - that are a really cool technology that once you understand their utility are really cool. I fear how others will use them not understanding their limitations.

not2b 3y ago

Except that search engine providers used to think they were in the business of providing accurate, quality information in exchange for ad revenue (before they took one step after another to degrade this in pursuit of revenue growth). People judge how accurate an answer is by doing searches, hoping to find reputable information to check an assertion. If all they can find is confident-sounding crap, how good is their judgment going to be?

astrange 3y ago

Bard is much less capable than GPT4, if you're only using the free tier. What I notice about Bard is that it hallucinates almost anytime I ask it anything. "Compare and contrast <two things that don't exist>" is a good one.

tyre 3y ago

> one of the things you have to judge is how accurate the answer is. The LLM can't assess that Not quite true. Some LLMs are surprisingly good at predicting their confidence in answers (where a series of 80% confidence output should end up being right 80% of the time.) “Language Models (Mostly) Know What They Know” by Anthropic: https://www.anthropic.com/index/language-models-mostly-know-what-they-know https://www.anthropic.com/index/language-models-mostly-know-...

avgcorrection 3y ago

> LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment. There is an adage—and there are many variations—that says something like: a falsehood can travel half-way across the world before the truth has time to put on its boots.