In 5-10 years you'll be able to train models that blow right past these limits at home given the rate at which chip makers are diving into the specialized AI ac

In 5-10 years you'll be able to train models that blow right past these limits at home given the rate at which chip makers are diving into the specialized AI accelerator market. This reminds me of key size limits back during the cryptography wars of the 1990s. "Nobody would ever need a key larger than 64 bits." Then 5 years later keys this small can be cracked on a gaming desktop.