4 ms·
> In fact, a tremendous amount of money is being invested right now to reduce/control hallucinations. Ok, I can only laugh on this. Those "hallucinations" are
by marcosdumay 3y ago
> In fact, a tremendous amount of money is being invested right now to reduce/control hallucinations.
Ok, I can only laugh on this.
Those "hallucinations" are the one main feature neural networks. It's imposed by their fundamental structure, and what gives it all if its usefulness... when the people making use of it knows what they are doing.
The way to reduce/control the hallucinations of a neural network is to unplug it from the power outlet.
- navjack27 3y agoAbsolutely agree. I use LLMs for their hallucinations and barely for their recall of "facts".
- cs702 3y agoThe hallucinations are a consequence of sampling from a probability distribution over all possible tokens at each step. There are a lot of very smart people trying to figure out how to sample for generative purposes while "grounding" the model so it hallucinates less. It's an active area of research.