14 ms·
Congratulations to the Spanner team for becoming part of the Google public cloud! And for those wondering, this is why Oracle wants billions of dollars from Go
by ChuckMcM 10y ago
Congratulations to the Spanner team for becoming part of the Google public cloud!
And for those wondering, this is why Oracle wants billions of dollars from Google for "Java Copyright Infringement" because the only growth market for Oracle right now is their hosted database service, and whoops Google has a better one now.
It will be interesting if Amazon and Microsoft choose to compete with Google on this service. If we get to the point where you have databases, compute, storage, and connectivity services from those three at equal scale, well that would be a lot of choice for the developers!
- snikch 10y agoAmazon's Aurora databases seem to be solving the same problem, and are MySQL or Postgres compatible to boot.
- deleted 10y ago[deleted]
- manacit 10y agoAurora is a 'better MySQL mousetrap', IMO. This is a globally-available, nearly-CAP-beating datastore that powers one of the biggest websites on the internet. It's not quite apples and oranges, but this is definitely a different problem they are solving.
- abalone 10y agoThat's vague. AWS also powers huge websites and Amazon is recommending Aurora as the "default choice" for most workloads.[1] There are certainly significant architectural differences but I would say we can definitely make a direct practical comparison. [1] http://www.computerworld.com/article/2953299/cloud-computing/amazon-takes-on-mysql-with-aurora.html http://www.computerworld.com/article/2953299/cloud-computing...
- cobookman 10y agoIf Aurora powers huge websites, spanner is for ginormous websites. Think a multiplier to netflix's database needs.
- dzhiurgis 10y agoCurious to know what are Netflix's needs for relational database? Doesn't strike me as a business with complex logic.
- cobookman 10y agoI'd assume they keep track of who watches what for their 'continue watching series...' pain. Netflix was given as an example of scale. I guess for another example, spanner could be used to store every visa transaction
- threeseed 10y agoNetflix mainly uses Cassandra as their database. And their needs are reasonably complex. They use machine learning and big data analytics to generate the list of videos that you should be watching. In order for those to work they need to capture a whole raft of end user metrics e.g. at what point you paused video X.
- deleted 10y ago[deleted]
- xapata 10y agoAurora's other zone replicas are read-only. Probably no atomic clocks and GPS for time synchronization. To be fair, Spanner's cross-region service is coming "later 2017".
- johnsmith21006 10y agoIt is not close to equivalent. But I do want to get a better feel for if Google really has figured how to do basically the impossible. I want to see if this truly scales horizontally but of it does then competitors better hope for a much more detailed paper :)
- deleted 10y ago[deleted]
- jack9 10y ago> It is not close to equivalent. It's equivalent, with different (unknown) constraints. Aurora is specifically for scaling workloads in the same way. You can say it's horizontal (machine) over vertical (resource) but it's all a matter of accounting. The big nono is the Spanner pricepoint. I will stick with Aurora for scaling based on traffic I use, over pricey timeslices. You would have to have quite a load to justify the switch from cheaper de jour solutions right now (AWS). Relying on the few that do, is a risk.
- tedd4u 10y agoAurora is very cool but won't help you much after you vertically scale your master and still need more write capacity. With Cloud Spanner you get horizontal write scalability out of the box. Critical difference.
- abalone 10y agoSo if I'm understanding you, with Aurora all writes go to one master and you're constrained by the biggest instance AWS offers. Is that right? Do you have a sense of what that limit is? There's a pretty big price difference between Spanner and Aurora at the entry level so it's useful to explore this.
- edaemon 10y agoYes, Aurora has a single write master, though it does have automatic write failover -- i.e. if the Aurora primary dies, one of your read replicas is promoted to the primary and reads/writes are directed to the new instance. That does constrain your primary's capabilities to the largest instance size (currently a db.r3.8xlarge). I don't have a good idea what the upper limit is for an Aurora database setup.
- macintux 10y agoHow does Aurora know that the primary is dead? Automatic failover is problematic in a distributed system.
- xapata 10y agoYeah, the latency on that failover isn't specified.
- edaemon 10y agoDo you mean the amount of time it takes to initiate a failover or the amount of time for a failover to complete? For the former, I don't think they specify beyond "automatic". For the latter, "service is typically restored in less than 120 seconds, and often less than 60 seconds": http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora.Managing.html#Aurora.Managing.FaultTolerance http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora...
- rattray 10y agoWhile Aurora doesn't provide true horizontal scalability, the same-node scalability seems so strong it might allow many companies to stay single-node for quite a while. For example, see this benchmark: http://2ndwatch.com/wp-content/uploads/2016/09/Graph-3.jpg http://2ndwatch.com/wp-content/uploads/2016/09/Graph-3.jpg from this article: http://2ndwatch.com/blog/benchmarking-amazon-aurora/ http://2ndwatch.com/blog/benchmarking-amazon-aurora/ Thoughts?
- deleted 10y ago[deleted]
- jahewson 10y ago> the only growth market for Oracle right now is their hosted database service This is not true. Oracle is far more than a database company nowadays in the same way that Microsoft is more than Windows. Oracle has been acquiring high-growth startups at a significant rate.
- ChuckMcM 10y agoI was going by this document: http://s1.q4cdn.com/289076952/files/doc_financials/quarterly/2017/Q2/Q217_Form8K_Exhibit99-1_Earnings_Release_Tables_12142016.pdf http://s1.q4cdn.com/289076952/files/doc_financials/quarterly... Which has their 'cloud services' doubling their contribution to revenue year over year and licenses losing 50% of their contribution to revenue year over year. There 'cloud' collateral is pretty opaque though.
- jahewson 10y agoYes, the "cloud" includes all of their non-database offerings too which have been the focus of recent growth/acquisitions.
- sbarre 10y agoA lot of Oracle's "cloud" products are just their traditional single-tenant/on-prem software that they offer to run for you in their own environments. You're still buying the same stuff, but you're outsourcing your dev ops to them on top of it (which may not be a bad thing).
- ArcherThrowaway 10y agoIt'll be interesting to see how well customers will adopt this. When I was at one of the two companies you mentioned above, we tried adding global snapshots (a la TrueTime, which is the real innovation in Spanner not the clocks) and demoed it to our DBAs/MVPs. They didn't understand what on-earth was going on. Wanted something that worked with existing clients. We just gave them classic 2PC and they went home happy. I think that's the reason why Oracle will keep on chugging. There just aren't that many workloads that need this sort of scale. It is real cool technology though and we always used to wonder why Google wasn't offer Spanner as a service.
- jchrisa 10y agoAs a bit of a veteran in the database industry, I concur (at least about the impact on Oracle's database business). There is a lot of pent-up demand for anything that offers distributed consistency. We've been seeing this demand at Fauna. FaunaDB offers distributed consistency, based on Raft and the Calvin protocol instead of depending on specific networking and clock hardware. We've seen a big part of our appeal is the ability to run FaunaDB across multiple cloud services.
- amalag 10y agoWhat is the monetisation plan? Purely SAAS with on-premise or an open source version with support like postgres/mysql?
- evanweaver 10y agoThe serverless cloud is pay-as-you-go. There is no minimum spend, unlike Spanner's $1000 per month (apparently). And it's cheaper than operating any open source on cloud hardware. On-premises is licensed by core. We have a developer edition you can use on your local machine, but we don't currently have plans to open source FaunaDB itself.
- rgrove 10y agoWhere did you read that Cloud Spanner has a $1,000 per month minimum spend? I can't seem to find any mention of this.
- arjunnarayan 10y agoMinimum 3 nodes * node pricing of $.90/hour = 30.924*30 = 1944/month.
- rgrove 10y agoWhere is this 3-node minimum mentioned? URL please? Edit: Looks like maybe you're referring to the recommended 3 node minimum in production mentioned at https://cloud.google.com/spanner/docs/instance-configuration https://cloud.google.com/spanner/docs/instance-configuration
- kornish 10y ago> It will be interesting if Amazon and Microsoft choose to compete with Google on this service. If we get to the point where you have databases, compute, storage, and connectivity services from those three at equal scale, well that would be a lot of choice for the developers! There are also plenty of choices evolving for developers who aren't looking for hosted solutions (which can sometimes be a showstopper for enterprise on-prem deployments). There's a growing ecosystem of distributed open-source databases to look out for too. Take Citus, for instance – a Postgres-compatible distributed store which automatically parallelizes normal SQL queries across machines. It's as easy to set up as adding an extension, and people are doing some staggering things in prod with it. Different audience from BigQuery and Spanner, but no less exciting. Disclaimer: no professional association, but love their product and the team.
- craigkerstiens 10y agoCraig from Citus here. Thanks for the kind words. We've seen a lot of people scale-out transactional workloads with Citus as well. In particular, we've seen a lot of multi-tenant apps that need to keep scaling beyond a single node when they're running into memory or compute issues. If you are looking for something that is more Postgres flavored (meaning we're just an extension to it so you get all the good stuff of Postgres such as JSONB, PostGIS, etc.) then we hope we'd be a good fit. And we run a managed service on top of AWS as well (https://www.citusdata.com/product/cloud https://www.citusdata.com/product/cloud) built by the team that built Heroku Postgres. If curious on pricing you can find it at https://www.citusdata.com/pricing/ https://www.citusdata.com/pricing/
- sandGorgon 10y agoIt would be very interesting to have your product at the 200-300$ pricepoint. Currently, the lowest tier starts at almost 2000$ per month for the high availability version. I'm not trying to compare on a per-mb level, but it would be nice for smaller scale workloads.
- craigkerstiens 10y ago
- hueving 10y ago>well that would be a lot of choice for the developers! A sad choice though. The centralization of computation is likely not a good thing in the long run.
- scarmig 10y agoThe absolute level of computation available isn't changing at the consumer level. What's happening for the next decade is the destruction of businesses hosting their own IT infrastructure and moving it to a couple of core centers. So, the computational "Gini index" is increasing, but no one is being thrown into computational poverty.
- ocdtrekkie 10y agoThe parent comment doesn't seem to specify "consumer level" and the loss of businesses having their own infrastructure is equally troubling. Everyone is putting a lot of eggs in a very small number of baskets.
- cjmcqueen 10y agoI would disagree about the character of the situation. This isn't about people putting eggs in a few baskets, it's that it's more efficient to have centralized chicken coops instead of every family in the world owning their own chickens. Now, you could play with that analogy further and see some issues as well, but I don't think the issue here is centralized failure; all these data centers/"clouds" are at least good. The Cloud is about businesses focusing on core business and not supporting functions. [Disclosure, I work on the Google Cloud team, I'm biased]
- aaronblohowiak 10y agoMonocultures are efficient, but not healthy ecosystems in the long term.
- CaptSpify 10y ago> it's that it's more efficient to have centralized chicken coops instead of every family in the world owning their own chickens. Only if the owner of the chicken-coop has everyone else's best interests in mind. Protip: They don't. The Cloud isn't about efficiency, it's about data control. Getting people's systems and data into Google/AWS/etc helps with data mining, vendor lock-in, etc. Often times that can be efficient, but also it often isn't.
- daveheq 10y agoHow is Google's cloud MySQL better than Oracle?
- aanm1988 10y agoBecause Google built it and Google only builds the best so it is the best because Google. GOOGLE.
- dang 10y agoPlease don't do this here.
- ChuckMcM 10y agoI didn't downvote you. It is important to note though that the Spanner project isn't related to MySQL and there is some discussion of that in a the stories around Spanner. It would nominally compete directly with Oracle's flagship database product.
- dekhn 10y agoSpanner is related to MySQL at Google: a product with Spanner's semantics was required to replace MySQL for some important business operations (https://landing.google.com/sre/book/chapters/communication-and-collaboration.html https://landing.google.com/sre/book/chapters/communication-a...) it's actually hard to beat MySQL for a lot of things. i was skeptical about this when I joined google, but as an SRE on the MySQL team around this time, I gained a lot of respect for it.
- ChuckMcM 10y agoThat is an interesting way to look at it; I have wrestled with MDB[1] while working at Google, it was a ginormous MySQL database (possibly one of the world's largest). And I would characterize Spanner's relationship this way, "If you think you are actually going to build an ACID database that scales, then make sure you can support the MySQL api that MDB uses and we'll see just how well it scales." I don't know if anyone put it to them that way but as Spanner was just getting started when I left I know that one of its success criteria was to be able to be a scalable replacement for MDB. Given the white paper and other papers on their results, I'm sure it managed that requirement. [1] MDB, Machine Data Base, used throughout the org but especially in Platforms and SRE to keep track of machines and their parts.
- hinkley 10y agoIt seems like Oracle could have a play here, working on adapting cloud infrastructure tools for managing on-premises data centers. That keeps them in play for customers who can't put their data in the cloud and those that haven't because they're already Oracle customers. This pendulum swings. We're pretty near the apex now. A little work on ergonomics and these tools could be turn-key, and back we go to decentralized hardware.
- rodgerd 10y ago> It seems like Oracle could have a play here, working on adapting cloud infrastructure tools for managing on-premises data centers. That's what the ExaDatas are supposed to be.
- tyingq 10y ago>the only growth market for Oracle right now is their hosted database service, and whoops Google has a better one now It could end up that way, but lacking INSERT and UPDATE will likely limit this to a niche market for now.
- SoulMan 10y agoWell the product manager is from Oracle.