4 ms·

Since Google uses Spanner in-house extensively, it is likely to be available for a good long time.

justinsaccount 9y ago
> Google uses Spanner in-house extensively True > it is likely to be available for a good long time. Where does this conclusion come from? The google mapreduce paper was released in 2004. [0] "By 2014, Google was no longer using MapReduce as their primary Big Data processing model" [1] The google spanner paper was released in 2012. If spanner lives as long as mapreduce it will be largely replaced in 5 years. [0] https://research.google.com/archive/mapreduce.html https://research.google.com/archive/mapreduce.html [1] http://www.datacenterknowledge.com/archives/2014/06/25/google-dumps-mapreduce-favor-new-hyper-scale-analytics-system/ http://www.datacenterknowledge.com/archives/2014/06/25/googl...
- rrdharan 9y ago
  It's true that Map Reduce is no longer the "primary Big Data processing model" for some definition of primary. However, it is still very much available. There are still many important production MapReduce jobs running AIUI. [work at Google]
- wsetchell 9y ago
  I think you're talking about two different things: "will Google drop support" and "will Google invent something better" Map Reduce is still supported today. Most teams have chosen to move to newer infrastructure because it is better. Nobody forced those teams to move. Here Google has not dropped support, but has invented something better. [Disclaimer - work at Google, but not on anything related to Cloud]
  - gldalmaso 9y ago
    Google disproves Google. https://cloud.google.com/prediction/docs/end-of-life-faq https://cloud.google.com/prediction/docs/end-of-life-faq "As we've expanded our Cloud Machine Learning services, many of the use-cases supported by Cloud Prediction API can be better served by Cloud Machine Learning Engine." In this case "invent something better" == "drop support".
- euyyn 9y ago
  The MapReduce paper was released in 2004, and BigTable is still available.

> Google uses Spanner in-house extensively True > it is likely to be available for a good long time. Where does this conclusion come from? The google mapreduce paper was released in 2004. [0] "By 2014, Google was no longer using MapReduce as their primary Big Data processing model" [1] The google spanner paper was released in 2012. If spanner lives as long as mapreduce it will be largely replaced in 5 years. [0] https://research.google.com/archive/mapreduce.html https://research.google.com/archive/mapreduce.html [1] http://www.datacenterknowledge.com/archives/2014/06/25/google-dumps-mapreduce-favor-new-hyper-scale-analytics-system/ http://www.datacenterknowledge.com/archives/2014/06/25/googl...

rrdharan 9y ago
It's true that Map Reduce is no longer the "primary Big Data processing model" for some definition of primary. However, it is still very much available. There are still many important production MapReduce jobs running AIUI. [work at Google]
wsetchell 9y ago
I think you're talking about two different things: "will Google drop support" and "will Google invent something better" Map Reduce is still supported today. Most teams have chosen to move to newer infrastructure because it is better. Nobody forced those teams to move. Here Google has not dropped support, but has invented something better. [Disclaimer - work at Google, but not on anything related to Cloud]
- gldalmaso 9y ago
  Google disproves Google. https://cloud.google.com/prediction/docs/end-of-life-faq https://cloud.google.com/prediction/docs/end-of-life-faq "As we've expanded our Cloud Machine Learning services, many of the use-cases supported by Cloud Prediction API can be better served by Cloud Machine Learning Engine." In this case "invent something better" == "drop support".
euyyn 9y ago
The MapReduce paper was released in 2004, and BigTable is still available.