4 ms·
So... instead of disagreeing out of hand, how did you overcome the fact that you had to pay for bandwidth between your terabytes of data and the computation cen
by raylu 13y ago
So... instead of disagreeing out of hand, how did you overcome the fact that you had to pay for bandwidth between your terabytes of data and the computation centers?
- jaytaylor 13y agoTerabytes are cheap compared to my time. I've also never required that much training data, so perhaps your use case does not lend itself to these services. I've built automated ML model training systems myself with TreeNet and Mahout, as well as used API-based ML systems, and I'm comfortable saying there is a strong case to be made for services which save much unnecessary effort.
- raylu 13y agoStoring terabytes is cheap. Terabytes of bandwidth is very very expensive.
- neeleshs 13y agoSome old links on the cost of terabytes of bandwidth http://josephscott.org/archives/2009/01/how-much-does-one-terabyte-of-bandwidth-cost/ http://josephscott.org/archives/2009/01/how-much-does-one-te...
- raylu 13y agoAnd that assumes you're willing to host with those providers, many of whom don't provide computing power. Also, the machine learning service you are using has to pay again for that bandwidth too and that cost gets passed along to you.
- ivanist 13y agoTransferring 1TB at a sustained rate of 1MB/s will take about 11.5 days.
- lightcatcher 13y agoOne easy way to get around bandwidth costs is to just have the clients of your service communicate directly (via Javascript or other client-side code) with your "machine learning as a service" (MLaaS? :D) vendor. Of course this model only works for certain businesses and allows learning on certain things, but you can go a pretty long way with this.