4 ms·
> as a single developer I think you are out of luck already. Even with transfer learning, retraining BERT to fit a larger dataset takes ages even on an RTX 800
by bitL 7y ago
> as a single developer
I think you are out of luck already. Even with transfer learning, retraining BERT to fit a larger dataset takes ages even on an RTX 8000. A single state-of-art experiment/training run at Facebook now costs 7 figures. The age of individual SOTA ML researcher/developer is over.
- raducu 7y agoThis is so sad, actually, and It's not just ML, it is every kind of new tech and discovery. To me it shows we have already picked the easy fruits and technology will not continue to evolve exponentially.