3 ms·
I hit this wall in my own Deep Learning-based automation business; I am now forced to rely on transfer learning most of the time, my Tesla/Titan RTX-based in-ho
by bitL 7y ago
I hit this wall in my own Deep Learning-based automation business; I am now forced to rely on transfer learning most of the time, my Tesla/Titan RTX-based in-house "server" is no longer capable of training latest greatest models in reasonable time, cloud is out of question due to costs and (automated) parameter tuning with distributed training takes ages. I can still ask a lot for customized solutions, though I see the writing on the wall that it might not last too long (2-4 years) and I'd have to switch business as there will be only a handful of companies able to train anything that is better than current SOTA.
- thewarrior 7y agoBut do you need SOTA for your business to be viable ?
- bitL 7y agoWell, right now I can get within 1-3% SOTA performance for models I need but I expect that in 2-4 years I'll be much farther away with laughably outdated models nobody would want to pay for. Like now I can replace 100s of people in e.g. quality control as they make e.g. 15% errors and I can bring that down to e.g. 8%. But later big boys might be able to bring it down to 1% for $2M training cost and I wouldn't stand a chance.