6 ms·
Please. No one is ignoring this problem. In fact, a tremendous amount of money is being invested right now to reduce/control hallucinations. It's an active ar
by cs702 2y ago
Please. No one is ignoring this problem.
In fact, a tremendous amount of money is being invested right now to reduce/control hallucinations.
It's an active area of research. Everyone with money is trying to solve the problem!
- simonw 2y agoThe Google I/O keynotes yesterday most definitely ignored the problem - it wasn't acknowledged once, and many of the demos they showed are a lot less impressive when you consider the hallucination risk.
- marcosdumay 2y ago> In fact, a tremendous amount of money is being invested right now to reduce/control hallucinations. Ok, I can only laugh on this. Those "hallucinations" are the one main feature neural networks. It's imposed by their fundamental structure, and what gives it all if its usefulness... when the people making use of it knows what they are doing. The way to reduce/control the hallucinations of a neural network is to unplug it from the power outlet.
- navjack27 2y agoAbsolutely agree. I use LLMs for their hallucinations and barely for their recall of "facts".
- cs702 2y agoThe hallucinations are a consequence of sampling from a probability distribution over all possible tokens at each step. There are a lot of very smart people trying to figure out how to sample for generative purposes while "grounding" the model so it hallucinates less. It's an active area of research.