2 ms·
Never, ever make assumptions about what the model can and cannot do based on what it tells you itself. This is one area where they hallucinate a lot, even top-o
by int_19h 3y ago
Never, ever make assumptions about what the model can and cannot do based on what it tells you itself. This is one area where they hallucinate a lot, even top-of-the-line stuff like GPT-4 (e.g. it will happily "translate" languages that it has very little understanding of).
- thrdbndndn 3y agoWell I don't assume, I asked it explicitly what language it understands.
- codingdave 3y agoTaking any answer from an LLM as accurate is in and of itself an assumption.
- int_19h 3y agoYou assumed that it knows which languages it understands, or that it knows that it doesn't know. This assumption is generally incorrect.