3 ms·
Correct me if I'm wrong, but this doesn't say what Twitter moved to the cloud. It could be literally anything, and may not in fact be core tweet or user data.
by echelon 8y ago
Correct me if I'm wrong, but this doesn't say what Twitter moved to the cloud. It could be literally anything, and may not in fact be core tweet or user data.
This strikes me as a team (or teams) outgrowing the storage options that were offered internally and choosing to outsource to fit their needs. Isolated use for one business case, and not indicative of a broad movement to the cloud on the part of the whole org.
I could be wrong, of course.
I'd like to know more. And I'd certainly like to know what the engineers at Twitter think.
- sidcool 8y agoYou are not wrong. The message here is that whatever data was transferred, Google was able to handle hundreds of petabytes of data. It could just be billions of photos of cats
- londons_explore 8y ago'cold storage' It's going to be logs data, backups, and users original uploaded data (rather than reencoded versions) that they hope will be valuable one day.
- fhoffa 8y agoyou missed this part "and our flexible compute Hadoop clusters"
- anvuong 8y agobillions photos of cats is invaluable data, mind you
- inferiorhuman 8y agoWell Twitter is now part of the official White House record, isn't it?
- andrewguenther 8y agoThe post on Twitter's side goes into more detail: https://blog.twitter.com/engineering/en_us/topics/infrastructure/2018/a-new-collaboration-with-google-cloud.html https://blog.twitter.com/engineering/en_us/topics/infrastruc... Relevant technical bits: > Today, we are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform. This will enable us to enhance the experience and productivity of our engineering teams working with our data platform. > Twitter runs multiple large Hadoop clusters that are among the biggest in the world. In fact, our Hadoop file systems host more than 300PB of data across tens of thousands of servers.
- tozeur 8y agoEvery post like this is just PR at the end of the day. Google’s goal is to prove to potential customers they can play with the big boys (AWS and Azure).
- geggam 8y agoIf you are using containers I would argue GCP is the place to be. If you are still using full VMs AWS is the place to be Azure is what I am running into when I get contracts in the midwest and I am really not sure why they are using it :)
- munchbunny 8y agoIf you're working with retail customers (retail giants included), AWS is pretty much banned in order to not pay a competitor, so you end up on Azure.
- geggam 8y agoHeh.. forgot that startup I worked at and ended up at Rackspace because of that :)