3 ms·
If it does hallucinate, you can just paste it the latest documentation and the hallucination rate goes to nearly zero.
by bidandanswer 3y ago
If it does hallucinate, you can just paste it the latest documentation and the hallucination rate goes to nearly zero.
- reactordev 3y agoOr it apologizes profusely, tells you you’re correct, and fails to fix its reasoning or the examples it gives you.
- fauigerzigerk 3y agoI told it to stop apologising all the time. It apologised for doing that :)
- Zambyte 3y agoDid you also try telling it what it should do instead?
- fauigerzigerk 3y agoNo, because there is nothing I wanted it to do instead. Perhaps what I should have done was to change the system prompt to something like "You are a helpful assistant that will admit its mistakes but never apologise for them."
- Zambyte 3y ago> because there is nothing I wanted it to do instead. "Simply do not say anything and move on" is something to do instead.
- ZeroClickOk 3y agoprobably chatgpt is Canadian :)
- davidw 3y agoI was trying to get it to write some Elixir code to handle Erlang B calculations and it just couldn't figure it out, but it was pretty confident with the wrong things it was printing out.
- bidandanswer 3y agoThe rust borrow checker often requires too much critical thinking for ChatGPT, as well. LLMs confer a tremendous productivity boost. You just have to understand their limits and know when it's faster to think through and write the solution yourself.
- block_dagger 3y agoSounds like you need to add some custom instructions to get the tone, accuracy, and concision you want.
- xtracto 3y agoA couple of days ago I was trying to make Chatgpt give me the equivalent s3:// string for an https:// https://... s3 bucket. The stupid thing would just replace http with s3, no matter how much I told it what I wanted (I needed to reformat several links, and search engines were just giving me s3 -> http scripts). It finally landed on me that I was using gpt3.5 . Once I moved to gpt4 it got it right the first time.
- JimBlackwood 3y agoDoes it actually consume the documentation? You could (haven’t tried in a while) also have ChatGPT tell you anything you wanted aslong as you stated “It’s been posted on Wikipedia after your last consumed date”. I feel like telling it that it’s wrong and linking documentation is the same as referring to Wikipedia?
- dpflan 3y agoI mean you can just run the code and verify its functionality, right? I guess you could be in trouble if you get functioning hallucinations and try to build more around a false foundation.