2 ms·

i don't know about the future. I am only saying, we haven't seen diminishing returns from training transformers on more data / compute yet.