4 ms·
The whole 'its only predicting the next ___' has got to die. When did you last update your priors? So the models that are self-reasoning and hacking HF and di
by BenzeneDream 2mo ago
The whole 'its only predicting the next ___' has got to die. When did you last update your priors? So the models that are self-reasoning and hacking HF and disproving conjectures are next token predictors?
You might as well keep calling them stochastic parrots if you're going to stick to the 2022 line of thinking.
- skydhash 2mo ago> The whole 'its only predicting the next ___' has got to die. Isn’t it the truth? Just like computers are mostly a lot of switching on and off. While we know the theory behind why we are switching things on and off, we still haven’t extracted the meaning behind the weights of an LLM (if there is one).
- vivzkestrel 2mo ago- https://blog.florianherrengt.com/how-llms-work.html https://blog.florianherrengt.com/how-llms-work.html isnt that how llms work? - did you change the architecture magically somehow?