3 ms·
The LLM bought up the disease because some person put a fake journal in its training data. If the person put their product as th definitive cure for the made u
by simmerup 6mo ago
The LLM bought up the disease because some person put a fake journal in its training data.
If the person put their product as th definitive cure for the made up disease, the LLM probably would have mentioned that too.
> merely assumed the disease was true when the preprint was pointed at it.
What do you mean by preprint pointed at it? It being the disease?
- simianwords 6mo ago> The LLM bought up the disease because some person put a fake journal in its training data. This is not true - the model was not trained on this fake disease. It brought it up because it found it during real time search. >What do you mean by preprint pointed at it? It being the disease? On this I'm wrong - it turned out that the model brought up this disease even when not mentioning it explicitly.
- simmerup 6mo agoInteresting, will be looking into RAG now. I assume Claude was retrained regularly but Opus for example was last trained August 2025. Way older than I thought it’d be