3 ms·
Have there been papers published about what happens to the user experience when average-context is tightly constrained to small weighting ranges or eliminated a
by yourapostasy 4y ago
Have there been papers published about what happens to the user experience when average-context is tightly constrained to small weighting ranges or eliminated altogether, and the model just throws an "insufficient data" error?
- Jensson 4y agoIt handles human grammar by averaging and assuming contexts so you can't really fix one side without hurting the other. Humans separates grammar from facts, but these language models don't, to them grammar and facts are the same thing so you can't just tell it to stop lying without it stopping to do all the grammar tricks we expect from it.