It's surprising, but in a weird way it makes sense if you think about it as "learning a pattern" instead of "doing math". The model doesn't have to understand l

It's surprising, but in a weird way it makes sense if you think about it as "learning a pattern" instead of "doing math". The model doesn't have to understand logic as we know it (and this class of models doesn't seem to be able to do that in general), but it does have to be able to learn the pattern somehow, and we already know LLMs can learn patterns from the input context without any fine-tuning. I'd like to try it on a dataset like Titanic. That might be a more interesting experiment. Or to avoid training data bias, maybe a completely random dataset generated by some more-sophisticated means, like the scikit-learn data generator which can introduce clusters, irrelevant features, etc.