4 ms·
...Why? An idiot will tell you the wrong answer with 100% confidence, and 0 valid basis to warrant said confidence. I swear, Babbage must be rolling in his gr
by salawat 4y ago
...Why?
An idiot will tell you the wrong answer with 100% confidence, and 0 valid basis to warrant said confidence.
I swear, Babbage must be rolling in his grave. Turns out the person asking him about putting garbage in and getting a useful answer out was just an ahead of their time Machine Learning Evangelist!
- josephg 4y agoIf the learning rate was scaled based on its own confidence output, then ideally the system should learn to have a low confidence in everything early in training, and only raise its confidence late in training as it gets increasingly confident in its own outputs.
- naijaboiler 4y agoLLM would have to fundamentally change. Current transformer architecture can not but hallucinate. It is inherent. More training won't solve it. A complete rethinking of the approach is the only way to
- nerdponx 4y agoMuch of the field of statistics is dedicated to estimating probability distributions from data. It's absolutely a legitimate question to ask.