3 ms·
One of the big complaints with LLMs is the confident hallucination of incorrect facts, like software APIs that don’t exist. But the way I see it, if ChatGPT th
by brookst 4y ago
One of the big complaints with LLMs is the confident hallucination of incorrect facts, like software APIs that don’t exist.
But the way I see it, if ChatGPT thinks the Python list object should have a .is_sorted() property, that’s a pretty good indication that maybe it should.
I work in PM (giant company, not Python), and one of these days my self-control will fail me and I will open a bug for “product does not support full API as specified by ChatGPT”.
- xiphias2 4y agoOr rather you can just catch method missing in the runtime and patch it with a chatgpt call
- brookst 4y agoLove it. Get ChatGPT to write the missing method, execute it this once, then store it in a file, update the current source file with the include to cache it for next time.
- int_19h 4y agoI can't find it, but someone already did a Python module that plugs into GPT-3 and automatically generates functions on the fly as you call them - and then the same for methods on the returned values etc.
- matthewdgreen 4y agoChatGPT also thinks certain coding algorithms should violate well-known information-theoretic bounds ;) I’ll put a ticket in with Claude Shannon.
- brookst 4y agoI’m sure he’ll be excited to learn about this gap!
- howlin 4y ago> LLMs is the confident hallucination of incorrect facts This is a very common feature of delirium in people. Chatting with an LLM seems a lot like what it would be to talk to a clever person with encyclopedic knowledge, who is just waking up from anaesthesia or is sleep talking.
- moffkalast 4y agoOr just the average person on reddit's r/confidentlyincorrect.
- dr_dshiv 4y ago> it, if ChatGPT thinks the Python list object should have a .is_sorted() property, that’s a pretty good indication that maybe it should. Yes! And when it hallucinates references for articles, often times those articles probably should exist…
- visarga 4y agoAnd if they don't exist, you ask the model to write them from title and link.
- moffkalast 4y agoThe year is 2145. When a new person is born their entire life is hallucinated in its entirety by the all great and powerful GPT. Deviation from His plan is met with swift and severe consequences.
- visarga 4y ago> if ChatGPT thinks the Python list object should have a .is_sorted() property, that’s a pretty good indication that maybe it should. Hahaha, Python language fixing itself!!!
- deleted 4y ago[deleted]