5 ms·
> In fact one of the core reasons transformers gained so much traction is because they scale so well. > If nothing really changes in 3-5 years, then I'd call i
by namaria 2y ago
> In fact one of the core reasons transformers gained so much traction is because they scale so well.
> If nothing really changes in 3-5 years, then I'd call it a flop
Transformers have been used for what 6 years now? Will you in 6 years say "I'll decide if they don't change the world in another 6 years?"
- Workaccount2 2y agoIf the difference between now and 6 years in the future is the same as the difference between now and 6 years ago, a lot of people here will be eating their hats.
- namaria 2y agoWhy? What exactly have we got for the (how many hundred) billions of dollars poured into GPUs running transformers over the past 6 years?
- Workaccount2 2y agoYou don't believe that models 100x better than today (OG transformers were pretty bad) would be fruitful for society?