3 ms·
Be able to say "I don't know".
by bonzini 4y ago
Be able to say "I don't know".
- JKCalhoun 4y ago(You've just excluded a few people I know.)
- deleted 4y ago[deleted]
- moffkalast 4y agoGPT 4 tells me that on a daily basis because of the 2021 data cutoff.
- bonzini 4y agoSo it never hallucinates APIs, theorems, biographies or places?
- moffkalast 4y agoWell I did at one point compare the outputs for two biographies of not very well known people, 3.5 made up half of the data, 4 only said it doesn't know anyone by that name for both. I don't think I ever tried asking about any places or theorems specifically. As for APIs, well I try to always provide adequate context with docs, otherwise it may still on occasion make up some parameter that doesn't exist or uses another library by the same name. Half the time it's really my fault by asking for something that just isn't possible in a last ditch effort to see if it can be done in some convoluted way. It sort of assumes "the customer is always right" even if it contradicts with what it knows is wrong I guess. It gets it right usually when it's at least mostly straightforward to implement something though.
- CamperBob2 4y agoIt's much better at avoiding hallucination than the 3.x generation was. The first derivative is all that matters. ML gets better over time; we don't.