At this point I think I'm leaning towards "organic brains are just next token predictors with impressive secondary heuristic systems". The fact that we can get

At this point I think I'm leaning towards "organic brains are just next token predictors with impressive secondary heuristic systems". The fact that we can get such impressive results from transformers which are such a poor approximation and completely stateless makes me think there really isn't any special sauce to it.