3 ms·
> A model that "knows" the rules will make no errors, a model that makes any errors does not "know" the rules. Simple as. Does this mean that human minds are m
by colordrops 4y ago
> A model that "knows" the rules will make no errors, a model that makes any errors does not "know" the rules. Simple as.
Does this mean that human minds are merely statistical inference engines and don't truly get the models either? Because they make tons of mistakes.
I'm starting to think that at scale, quantity starts becoming quality, and there isn't a fundamental difference between a model and statistical inference. It's like vector graphics vs pixels, after a certain level of detail they are the same.
- nickelpro 4y agoYes, there's not reason to think that every movement, every decision, that humans make is made according to a purely rules-modeled decision engine. If a GM makes an invalid move at chess, they demonstrably were not following the rules in that moment. That decision wasn't made according to a rules engine. They scanned the board, made a series of statistical inferences and other processes still well beyond our ability to describe, and made a move without validating it against all the rules and a complete observation of the board. This doesn't tell us anything about OthelloGPT, and honestly I think it was self-evident about humans already. "We are not calculators" shouldn't be a surprise to anyone.