well the magic of transformer architecture is that if the rules exist and are computationally tractable, the system will find them in the data, and we don’t hav

well the magic of transformer architecture is that if the rules exist and are computationally tractable, the system will find them in the data, and we don’t have to have a clue. so. how much data do we need?