We are basically on v2 of modern AI. Transformers significantly improved the effectiveness of training. A few more breakthroughs every few years (not guarantee

We are basically on v2 of modern AI. Transformers significantly improved the effectiveness of training. A few more breakthroughs every few years (not guaranteed) could mean better results with 1/100th the data.