3 ms·
> Can a machine with access only to statistical patterns in the distribution of text tokens infer the physical structure of reality? We can say, as certain as a
by fenomas 4y ago
> Can a machine with access only to statistical patterns in the distribution of text tokens infer the physical structure of reality? We can say, as certain as anything: No.
Um. How do you square that claim with the well-known Othello paper?
https://thegradient.pub/othello/ https://thegradient.pub/othello/
- mjburgess 4y agoThe board state can be phrased as moves. This paper profoundly misunderstands the problem. The issue isn't that associative statistical models of domain Z aren't also models of domain Y where Y = f(Z) -- this is obvious. Rather there are two problems, (1) the modal properties of these models arent right; and (2) they don't work where the target domain isn't just a rephrasing of the training domain.