3 ms·
Cloudflare could really shake things up on the ML side of things. The egress costs and GPU prices on AWS and GPC make them a nonstarter for most companies, forc
by m_ke 5y ago
Cloudflare could really shake things up on the ML side of things. The egress costs and GPU prices on AWS and GPC make them a nonstarter for most companies, forcing people to rack their own hardware.
- wmfiv 5y agoMost companies except the ones paying AWS/Azure/GCP a combined $100B+ per year and growing fast?
- m_ke 5y agoYes except for the ones that are lighting saudi money on fire by having softbank pay for it. A lot of ML startups end up buying hardware for training because they can get a GPU for what it would cost them to rent it for 2 months on GCP/AWS.
- wmfiv 5y agoThat sounds right about ML startups. But ML startups or even venture funded companies are a very small percentage of companies - especially when it comes to spending signficant dollars.
- m_ke 5y agoMy original comment was referring to companies who train their own machine learning models. They might not be spending the way large slow corporations and the government do but there's a lot of investment in the space and a ton of room for growth.
- mcherm 5y agoThe company I work for is one example (of MANY) that is finding it quite cost effective to host on AWS as compared to maintaining our own data center. That being said, I certainly wouldn't mind seeing AWS and Cloudflare get into a price war that lowered egress prices.
- m_ke 5y agoYes we use GCP for production workloads and enjoy the benefits of being to scale at will. I'm strictly speaking about hosting large multi TB datasets and running machine learning training jobs that end up costing thousands of dollars each.