> Othello-GPT Has any one written the obvious reply to this paper yet? It's false. It's not true. The rules and the board state it "learns" are just function

> Othello-GPT Has any one written the obvious reply to this paper yet? It's false. It's not true. The rules and the board state it "learns" are just functions of the token positions *by construction*; it is given the token positions. obviously it learns patterns in those positions. The paper is such a misfire, it's absurd. The problem with using a formal system to investigate this issue is that by construction the "distributional hypothesis" is true for that system. Ie., the pattern in distribution of the moves are (a very good model of) the rules and board-state. But this is clearly untrue for non-formal systems not constructed this way. Eg., text tokens are not distributed like causal structures in the world -- and it's absurd to suppose so. The distributional hypothesis is obviously false for almost every measurement system of interest: measures are not distributed like their causes. We invent measurement systems to encode information, not to be isomorphic to world-structure.