4 ms·

Despite warnings everywhere that accuracy isn’t part of what this generation of gpt-4 us all about, and the fact that Sama has said that right now they are opti

Despite warnings everywhere that accuracy isn’t part of what this generation of gpt-4 us all about, and the fact that Sama has said that right now they are optimizing for language capabilities and conversational flow rather than accuracy, every single article on the Internet criticizes accuracy. LLMs are designed to create “helpful” and “convincing responses” without any overriding guarantees regarding their accuracy or alignment with fact. Right in the chat interface for chat-gpt is says, “ChatGPT can make mistakes. Consider checking important information.” I’m sure accuracy will improve but it’s not a strong point for the current generation nor was it ever intended to be. Not coming at you, just trying to support your point. In my mind the fact that publishing houses are being co-opted (and I’ve seen it too) with this generation of LLM is more social commentary about the sad state of modern news and publishing. Imagine what happens when the LLM technology hits initial degrees or human equivalence.

dragonwriter 3y ago
> LLMs are designed to create “helpful” and “convincing responses” without any overriding guarantees regarding their accuracy or alignment with fact. This is an incoherent goal: accuracy and alignment with fact are a big part of being convincing and a bigger part of being helpful.
- happytiger 3y ago
  Being accurate and being helpful are different things. Otherwise there wouldn’t be liars.
  - dragonwriter 3y ago
    Being accurate is generally key to be helpful. That's the reason liars, while they certainly exist, are, all others things being equal, viewed as less helpful than non-liars.
bitwize 3y ago
The way I think of it is, LLMs are sold as HAL but really they're a better MegaHAL: https://github.com/kranzky/megahal https://github.com/kranzky/megahal For that reason I don't think LLM, alone, will be capable of human-equivalent intelligence.

dragonwriter 3y ago

> LLMs are designed to create “helpful” and “convincing responses” without any overriding guarantees regarding their accuracy or alignment with fact. This is an incoherent goal: accuracy and alignment with fact are a big part of being convincing and a bigger part of being helpful.

happytiger 3y ago
Being accurate and being helpful are different things. Otherwise there wouldn’t be liars.
- dragonwriter 3y ago
  Being accurate is generally key to be helpful. That's the reason liars, while they certainly exist, are, all others things being equal, viewed as less helpful than non-liars.

bitwize 3y ago

The way I think of it is, LLMs are sold as HAL but really they're a better MegaHAL: https://github.com/kranzky/megahal https://github.com/kranzky/megahal For that reason I don't think LLM, alone, will be capable of human-equivalent intelligence.