3 ms·
> Building a data platform with a team of 3 people that can handle 10+ petabytes of data is easy. I'd hate to see that server bill. I'm sure Google or Amazon w
by falcolas 10y ago
> Building a data platform with a team of 3 people that can handle 10+ petabytes of data is easy.
I'd hate to see that server bill. I'm sure Google or Amazon would be happy to host that for you, at the cost of a full round of funding a month.
Point of reference: I worked for a company doing some basic ML analysis on the Twitter firehose; only a few tens of gigs a day. Their hosting costs were significantly over half of their overall operating costs (despite huge discounts, and including downtown New York offices), and they still hadn't gotten profitable when I left (they had actually gotten to the point where they were laying people off).
None of it was serverless either - it was measurably incapable of operating at the scale they required.