4 ms·
This is written by someone who has no idea how transformers actually work
by danjc 1y ago
This is written by someone who has no idea how transformers actually work
- neuroelectron 1y agoFurthermore, if you simply try to push certain safety topics, you can see how actually can reduce hallucinations or at least make certain topics a hard line. They simply don't because agreeing with your pie-in-the-sky plans and giving you vague directions encourages users to engage and use the chatbot. If people got discouraged with answers like "it would take at least a decade of expertise..." or other realistic answers they wouldn't waste time fantasizing plans.
- ricksunny 1y agoContra: The piece’s first line cites OpenAI directly https://openai.com/index/why-language-models-hallucinate/ https://openai.com/index/why-language-models-hallucinate/
- scotty79 1y agoIt could be that nobody knows how transformers actually work.
- progval 1y agoI don't know what to make of it. The author looks prolific in the field of ML, with 8 published articles (and 3 preprints) in 2025, but only one on LLMs specficially. https://scholar.google.com/citations?hl=en&user=AB5z_AkAAAAJ&view_op=list_works&sortby=pubdate https://scholar.google.com/citations?hl=en&user=AB5z_AkAAAAJ...
- j_crick 1y ago> The way language models respond to queries – by predicting one word at a time in a sentence, based on probabilities Kinda tells all you need to know about the author in this regard.