Deep Mind had this paper on that, showing weaknesses of transformers relative to other models in generalizing from example productions from different tiers of t

Deep Mind had this paper on that, showing weaknesses of transformers relative to other models in generalizing from example productions from different tiers of the hierarchy: https://arxiv.org/abs/2207.02098 https://arxiv.org/abs/2207.02098