3 ms·
Calling llm slop "hallucinating" is so counter-productive imo. After all, LLMs are just a variant of markov chains and as such this technology isn't able to dis
by remix2000 5mo ago
Calling llm slop "hallucinating" is so counter-productive imo. After all, LLMs are just a variant of markov chains and as such this technology isn't able to discern falsehoods from truths. It's like trying to use a barometer to tell the time.
- hit8run 5mo agoYou are also just a variant of markov chains wired in your brain. So what you complaining about?
- __natty__ 5mo agoAnd often it’s not perfect either. Just because one is true it doesn’t dismiss the other
- remix2000 5mo agoWell the difference here is that you're overly simplifying complex biology and many other factors whereas llms are in fact actually simple mathematical models. As always, the devil lies in the details. Dismissing intricacies is a useful tool for daydreamers, not so much for engineers.
- sometimelurker 5mo agoLLMs actually aren't simple Markov chains tho, your also simplifying. and LLMs trained with RLVR aren't just optimized over the space of functions (like gpt2 was), they're optimized over the space of programs (programs under some length). You find the ideal algorithm that can do the task you need it to.
- qwery2 5mo agoRLVR is a process which updates the Markov chain
- deleted 5mo ago[deleted]