5 ms·
Just like with a junior coder who, when asked about something they don't know, says whatever in hopes it's close enough to the real answer. If the conversation
by klibertp 4y ago
Just like with a junior coder who, when asked about something they don't know, says whatever in hopes it's close enough to the real answer. If the conversation is over Slack and you don't have out-of-band information, like what facial expression they have, it's basically 100% equivalent to ChatGPT. Only, ChatGPT is actually better at lying, because there's no noticeable difference between the style of real vs. wrong responses, so you need to be a bit more careful.
In other words, follow-up questions and cross-referencing are a must. You can't take any of ChatGPT answers as true without verification. You also need to be really careful when asking questions, because if you give it too many assumptions, it's absolutely great at confirming your biases for you.
I find it to be a great "rubber duck" that can help you see and understand the relationships between facts that you might have missed otherwise. OTOH, it'll be many, many years before I'm comfortable asking it about things I'm not already mostly familiar with or can verify easily.