2 ms·

For a transformer, context is limited, so the same kind of problem applies after you exceed some size.