4 ms·
The most reasonable explanation is that it allucinated it, was trained to answer that or it was in the prompt. These models are stateless, they don't remember
by estebarb 3y ago
The most reasonable explanation is that it allucinated it, was trained to answer that or it was in the prompt.
These models are stateless, they don't remember anything, they are read only. If they can remember previous messages is just because the prompt is the concatenation of the new prompt and something like "summarize this conversation: {whole messages in conversation}".
(Disclosure: I work at Microsoft, but nowhere near anything related with copilot.)
- djbusby 3y agoModels can be stateless while the API/UI has state, which can leak
- sandyarmstrong 3y agoWas going to say the same, I'll bet it's listed as an example question in the prompt or something like that. Seems unlikely to be a hallucination since multiple people got the exact same question. (Also happen to work at Microsoft, also don't work on Bing Copilot)