9 ms·
Michael Stonebraker: Why Enterprises Are Uninterested in NoSQL?
- SilianRail 16y agoNot true, they are just aren't doing "NoSQL" specifically: http://www.sap.com/press.epx?pressid=13293 http://www.sap.com/press.epx?pressid=13293
- kujawa 16y agoThere's a positive review if I've ever heard it: "Enterprise thinks it sucks". If I live a dozen lifetimes, I hope to never write another line of "enterprise" code again.
- limist 16y agoIn short: 1) No ACID Equals No Interest 2) A Low-Level Query Language is Death, and 3) NoSQL Means No Standards. ACID, complex querying, and standards matters when dealing with something more than a string dealing with what someone had for lunch. But while Stonebraker is convincing and very credible, can his message really compare with these talking heads? http://www.xtranormal.com/watch/6995033/ http://www.xtranormal.com/watch/6995033/
- ahoff 16y agoThe disclosure at the bottom is laughable. It should read, "Michael Stonebraker has a strong economic incentive to steer enterprises away from NoSQL. Whenever a company chooses NoSQL, he will lose money. Hence, his opinions should be considered in this light." Oh, and full disclosure, I have a strong economic interest in promoting NoSQL.
- jbellis 16y agoNot sure why this is being downmodded. Stonebraker has a history of using his reputation to promote his businesses. Which is fine, but I don't think most people realize how much of a financial interest he has in downplaying nosql. Something his competitors like ahoff and I are very much aware of. :)
- davidw 16y agoIt's a bit over the top: "Whenever a company chooses NoSQL, he will lose money." - it's not like Stonebraker gets money every time someone sets up Mysql, or even Postgresql, which, IIRC, he was involved with at some early point in its history.
- ahoff 16y agoI'll admit it was a bit snarky, and written in haste. You said it much better. He wants to play the role of an objective observer here, almost like an expert journalist. But he definitely has skin in the game.
- jhugg 16y agoAs somebody who knows Mike Stonebraker and works for one of his RDBMS companies, I can honestly say he says this stuff because he really believes that NoSQL is history repeating itself. Whether it's hierarchical databases, XML databases, objective databases, proprietary query languages, etc..., people keep trying new things and then coming back to the relational model and SQL. When people say "This time it's different", he gets annoyed. Maybe this time he's wrong, but with an understanding of the history of databases, it's easy for me to see his point of view. Honestly, I'm not sure if antagonizing the NoSQL community helps his companies or not. The NoSQL crowd is pretty passionate.
- ahi 16y agoI don't mind that Stonebraker has a conflict of interest. He's marketing, I get it. I do mind that ACM has given him the platform to do it. Any other ACM publication would consider it incredibly unethical to publish articles with such clear conflicts.
- terra_t 16y agoIt's a funny thing. Very powerful and scalable parallel SQL-based RDBMS systems have been commercially available for a long time. Also, I think that scalability concerns about ACID are exaggerated: ACID doesn't reach Facebook or Amazon scale, but there's only 5,000 or so sites that are that big. A converse question to the one they ask is, "Why aren't web developers interested in Commercial Parallel RDBMS" and I think the answer to that is that there are a generation of us who grew up using open source databases, who find the thought of using a commercial database like sticking their hand in a toilet... Even if it's a reasonably priced product like SQL Server's Web Edition. A lot of people see mysql and pgsql as going nowhere, so there's a lot of interest in something like mongodb which has a future.
- davidw 16y ago> pgsql as going nowhere Eh?! They just released a major update with long-awaited functionality!
- terra_t 16y agopgsql has a badly nonstandard type system (lots of SQL queries that work in Oracle & mysql don't work in pgsql.) I've still got a long list of queries that run 100x faster in mysql than pgsql
- pbh 16y agoI'm very confused by this comment. Did you switch mysql and pgsql in this comment, or was this what you meant as written? MySQL has always struck me as having a non-standard and quite strange type system (broken time/date types without microsecond accuracy, explicitly sized text types, ...). I've always seen PostgreSQL being marketed as a drop in replacement for Oracle due to superior standards support. If anything, PostgreSQL seems much more similar to Oracle than MySQL. I'm also very curious what sorts of things I should avoid if you really do have a very long list of queries that PostgreSQL handles really poorly.
- 16y ago
- rmorrison 16y agoAnother big reason: money is not an issue. You want to create ten interconnected tables w/ a bajillion records each, then query across them needlessly every microsecond? No problem, with enough money and hardware there are ways to make almost anything happen using commercial SQL databases.
- muloka 16y agoYour statement reminds me of this quote "A boat is a hole in the water which you throw money into." This is the general point of view executive committees have of IT. A necessary cost to keep them afloat in the sea of business. So as much as money is not an issue the bottom line at most enterprises is money. If you figure out how to greatly reduce the overall costs IT, or in this case data storage, the enterprise company you work for will probably appreciate it.
- kenjackson 16y agoThe disappointing aspect isn't that they aren't interested in it, it's that they don't know about it. At the end of the day, there are a lot of trendy technologies that I have no use for. But its good to know about them. I probably have about equal use for NoSql as I do SQL (the first professional code I ever wrote was a NoSql database, although we didn't call it that back then). You choose what's best for the job, but in order to know what's best you have to know what's out there.
- davidw 16y agoTo play devil's advocate, aren't a lot of these places where it's best not to rock the boat and risk screwups? In other words, they'll learn about new things in good time once they have big companies advertising them and have been around the block once or twice. Whether that's sensible or not, I'm not in a position to judge, just that in that sort of world, perhaps learning about things a bit late is not a problem.
- kenjackson 16y agoTrue enough. And in hindsight, I think asking people if they've heard of "NoSql" is somewhat an unfair question. The term itself is s trendy one. I'm sure there are probably people who have fixed more lines of code in NoSql databases than most people have here have written, and don't know that specific term.
- ahi 16y agoDisagree. It's everywhere in tech news sources. If you read any tech news on a regular basis you can't possibly be unaware. Part of being a professional is keeping on top of new products/solutions in the field, even if they aren't immediately useful.
- shawndumas 16y agoWe are looking in to using Node.js/Redis/Socket.io to track changes to useful profile data across all of our intranet applications in real-time. No change to the current ACID setup; just hooks at the client-end. No need to persist; speed and efficiency is top priority. No extra hardware; just an extra load on our content servers. And though we are probably in the minority we are Enterprise nonetheless.
- protomyth 16y agoIs there a company with a NoSQL product that is selling support contracts and is listed with Dun & Bradstreet? What do the reports from Gartner and Forrester Research say? Can I sue someone if something goes wrong. Did the options get evaluated with the corporate IT database committee? The sad part is that is how it works in a lot of companies and not just a bunch of snark. Since SQL is so entrenched and most IT shops have contractual relations with SQL vendors with lots of money (Microsoft and Oracle), I don't see a lot of ability to get NoSQL into the enterprise environment. Not to mention the legacy software that means SQL Databases are needed, so why add a whole new type?
- jchrisa 16y agoMy company CouchOne offers commercial support for CouchDB (which consequently has quite a bit of enterprise uptake, contrary to Stonebraker's assertions). I think there is something to the argument that without commercial support, companies won't be adopting these technologies.
- mathgladiator 16y agoI try to look at the bigger picture think how can companies like yours help companies like mine starting up so we can tear down the entrenched SQL forces.
- davidw 16y ago> tear down the entrenched SQL forces. Sounds like a terrible idea to me. What you should be doing is building new things where SQL is not such a good solution, rather than "tearing things down".
- LiveTheDream 16y ago> why add a whole new type? Because using the right tool for the right job makes sense. SQL is great for lots of things. NoSQL hits the sweet spot for other applications.
- 16y ago
- sudonim 16y agoPlease don't use double negatives... shouldn't this read "Why Enterprises are Interested in SQL". (And it's a statement not a question).</snark>
- deleted 16y ago[deleted]
- fleitz 16y agoBecause NoSQL systems are a tool, enterprises have invested heavily in workforces and capital that are centered around SQL. It's relatively easy as an enterprise dev to get a SQL database that is going to be backed up and restored by their admins. It's ok to lose the odd 'Like' it's not ok to lose the odd deposit. Since enterprise businesses are generally not built on a freemium/advertising model, they have the resources to buy systems that are accurate first, and then furnish hardware to provide the speed. Another problem with NoSQL is that while the core database functionality is there, the rest of the tool chain is missing. Show me a NoSQL database that has tools on par with SQL Server management server, or has tools that integrate well with Visual Studio. Simply put, the use-case for NoSQL is not what enterprises need. SQL fits the use case far more than NoSQL. Keep in mind that a lot of large enterprise applications still run on mainframes. If you actually think about it, most mainframe applications are NoSQL because they are still using datastores so ancient and basic that they are essentially NoSQL.
- jshen 16y agoI'm not sure I agree with the definitions of enterprise being implied in the comments here. I'm at a giant company all of you have heard of and we have the sql server visual studio enterprisey people that the article mentions, and they fit the articles description to a T. I also work directly on analytics for our company, and good friend of mine does analytics for another giant corporation nearby that all of you have also heard of. I believe our companies would be considered "enterprise", yet neither of us work at banks, neither of us work with ecommerce or supply chains for physical commodities, and neither of us are at tech companies. We both have groups heavily invested in sql, yet it is the wrong solution for both of us. Our enterprisey people had never heard of NOSQL or things like hadoop. Fortunately we're coming around and are starting to move things to hadoop, but the article matches my personal experience, and ACID is a requirement for the analytics we do. Our analytics are fuzzy by nature, yet we've been stuck in the sql enterprise mindset for years.
- edw519 16y agoTrivial example of what people need to know in enterprises: “Tell me whether pet rocks are selling better than Barbie dolls in the south?” What people really need to know: I already know from existing reporting that 984 orders (18% of our backlog) are already past due. For those 984 orders: - How many are for one item and how many are for multiples? - Do we own what we owe those customers? - If we do own it, is it in the proper warehouse? - If it is in the proper warehouse, can we find it? - If we can find it, is it undamaged and certified? - If it's shippable, do we have enough labor to ship it? - If it isn't certified, how soon can QA certify it? - If it isn't in the right warehouse, can we move it? - If we don't own any, where can we get some? - Which vendors have it on the shelf? - Which vendors do we have blanket purchase orders with? - Which vendors do we have contracts with? - Which orders can be split to satisfy a partial? - Which orders are for customers already on credit hold? - Which customers are threatening not to renew with us? and (ironically) the most asked question of all: - Which orders must be shipped to hit our quarterly numbers? I can go on and on; this is just off the top of my head. We like to pick on enterprises, but this is the shit that really happens all the time. So whenever you get gas in your car, bread on your table, new shoes at the mall, steamed milk in your latte, etc., etc., etc., rest assured that someone, somewhere has asked these questions. Questions that were probably answered using some form of RDBMS, SQL, ACID technology (with really good application software on top of it).
- thibaut_barrere 16y agoSQL is actually quite often a bad way to try to answer those questions, too! See http://philip.greenspun.com/wtr/data-warehousing.html http://philip.greenspun.com/wtr/data-warehousing.html for an entertaining explanation. I believe MongoDB in particular can be a fairly good solution to build datawarehouses (I'm starting to use it for reporting systems). One great point about MongoDB is that it makes the ETL process a lot easier (you don't have to prepare tables with the right schema and it supports large amounts of data). I wouldn't be surprised to see some NoSQL solutions get wider adoption in the enterprise, either alone or with tools that build upon them. As for the article: it's pure linkbait in my opinion!
- 16y ago
- batasrki 16y agoThe most disappointing thing about this post is the fact that we're supposed to be preaching "use the best tool for the job" to the young ones. And here is someone that anyone interested in database technologies has heard about and is regarded as an expert denouncing a whole slew of potential database solutions based on the opinion of one person. And ACM publishes it!
- baconner 16y agoOn the contrary the post explicitly goes into the reasons why current nosql solutions may not be appropriate for enterprise oltp systems. Seems to me that the post didn't say nosql solutions are bad for all enterprise apps just that rdbmses may be the better solution for the bulk of them. So that's not an argument to choose the right tool for the right job? I think it is...
- lubos 16y agoMany years back before this NoSQL madness took off, I was building my own "NoSQL" database. It was fast, refreshing and it seemed like common sense. Then as I was adding more and more features, I realized my neat "NoSQL" (I didn't call it this though) database is turning into relational one. I've come full circle back to relational stores. Only then I fully understood why relational aspect is mathematically superior to any other paradigm out there and why it's only SQL that really sucks. Perhaps this will happen again to mainstream NoSQL movement. It certainly wouldn't surprise me. So instead of making surveys why enterprises don't jump on NoSQL bandwagon, I would be more interested to know how many of NoSQL adopters ever heard of Codd's theorem or how many of them can differentiate between SQL and relational model. Relational model is a good thing, throwing it out and start from scratch feels like throwing out the baby with the bathwater. That's how I feel about NoSQL movement.
- hello_moto 16y agoCorrect me if I'm wrong. I thought some of the "enterprises" have already using NoSQL as part of their data warehousing strategy? To my knowledge (which might be wrong), there are companies out there such as Greenplum, Teradata, Netteza, Oracle Exadata that specialize in data-warehousing solution, have built their own DBMS based on column-oriented.
- etm117 16y agoI am not positive myself, but I believe that Greenplum and/or Netteza are built on top of Postgres (highly customized) DB engines to ensure their transactional integrity across their clustered servers.
- rxin 16y agoColumn or row-oriented really has nothing to do NoSQL or not. I'd argue NoSQL is a bad name, and as pointed out by previous commenters, many that are involved in the argument don't even understand ACID/SQL/relational algebra.
- ludwigvan 16y agoAbout the proliferation of NoSQL, check out this Changelog episode where "things got a bit rowdy when the panel debated features of Cassandra, CouchDB, MongoDB and Amazon SimpleDB and started throwing dirt at everybody else’s favorite NoSQL databases." http://thechangelog.com/post/457259567/episode-0-1-8-nosql-smackdown http://thechangelog.com/post/457259567/episode-0-1-8-nosql-s... This is 6 months old btw.
- davidw 16y agoI'm not an enterprise guy at all, but here's another thing worth considering: if even I, web 2.0 dude, am a bit confused by the array of things out there, and think that waiting until they battle it out and only a few are left at the top might not be a bad strategy, what is some corporate IT guy going to think?
- dasht 16y agoI think a lot of the comments here (not all) display a relative naivete about what is meant by ACID and why the physical / logical separation of SQL is vital to the point about ad hoc queries. It's ironic because some of those comments complain about enterprise types not knowing about NoSQL while, at the same time, the comment makers seem to not (really) know about SQL RDBMS systems.
- mmt 16y agoI, too, have found this to be the general case. I speculate that this is because they consider MySQL to be the archetype RDBMS. I have yet to run into such depth of misconception from those who work with Postgres.
- sriramk 16y agoI dont think it is about the technology at all. It is more about social factors. Enterprises often shy away from being on the leading edge of anything. There is very limited upside and big downside. I'm willing to bet that once the NoSQL space shakes down with some big winners, some defacto standards, enterprises will be adopting it just the same. Enterprises also need to be sold to. I don't see any startup having a sales team pushing NoSQL solutions inside the enterprise (Amazon's SimpleDB and my own team's Windows Azure Tables might be exceptions).
- jfager 16y agohttp://cloudera.com http://cloudera.com http://riptano.com http://riptano.com http://couchone.com http://couchone.com http://10gen.com http://10gen.com http://neotechnology.com http://neotechnology.com http://basho.com http://basho.com ...
- sriramk 16y agoNone of them are 'large' enterprise companies - think Oracle, MSFT, IBM, etc.
- arethuza 16y agoHierarchical OLAP databases applications are pretty widely used in enterprises and they often look nothing like an SQL database to users (sure something like Oracle Hyperion may have a relational database buried under there somewhere but the exposed data model sure isn't relational and things like Essbase are pretty similar but don't have any underlying SQL).
- ajsharp 16y agoWithout reading the article, I can sum this up in two words: perceived efficiency.
- 8ren 16y agoBefore relational databases and SQL, there was a successful industry of hierarchical databases (key-value stores), which was so utterly annihilated that not one vendor remained to give testament. RDB has since become standard. One aspect of a "standard" is uniform interfaces or one-size-fits-all, an essential aspect of which is that it doesn't suit all needs perfectly. It's a modular approach, that involves adapting non-quite circular circles and non-quite triangular triangles to perfectly square slots. You see it in mathematics and (eg) OO polymorphism all the time. It's an unpleasant but often worthwhile tradeoff. But at the edges, that tradeoff becomes questionable. And the web's REST is a new giant, whose clothing needs a different shape altogether. Applying RDB to it is so ill-fitting and irritating and obviously wrong that hierarchical databases have found a new home and a new life and a new name, NoSQL. But when NoSQL attempts to spread to others, it is surprised and hurt to find them already tailored for. --- The above fable is light on detail. There are many complex issues in the NoSQL/RDB comparison, since both have adapted to the detailed problems of their respective domains. However, I think the key aspect is that RDB is meticulously thought out in terms of information, and only then adapted to specific engineering needs. Specifically, it has normal forms and schema (needed for normal forms.)
- j_baker 16y agoSay what you will about SQL databases and I'll probably agree with you. However, larger organizations have to think at a much larger scale than the typical startup does. Migrating from a SQL database to a NoSQL database is a much more difficult decision to make once you reach a few hundred thousand lines of code, much less millions. And I haven't even gotten into the logistical issues yet. Do we have server capacity for the new database? Do we have people who know how to administer the new database? Can I install it in under a month on our server running <insert outdated version of RHEL here>? And these questions become doubly important if your clients are running your software on their own servers. Now not only are these logistical issues, they're excuses for your clients to drop you and go with someone else. To make a long story short, if NoSQL databases are worth it, enterprises will get there. But it's going to take a while. Much as us engineers hate to admit it, that might even be a good thing.
- muloka 16y agoEarlier CitizenKane made a point about the lack of standards across SQL databases in general. As such migrating from one SQL db to another would probably present just as equally a challenge. Let me tell you migrating from Informix 9.4 to SQL Server 2005 was no walk in the park.
- muloka 16y agoIn terms of the adoption of NoSQL databases (or any dev technology) within your enterprise, write a small and useful app as a side project in your spare time. Once you're done present it to your manager (or team lead) and I'm sure it'll increase its chance of it becoming more widely used within said company.
- chunkbot 16y agoThe title isn't a question, it's a statement. I'm pretty sure Mr. Stonebraker's English is better than that.
- smokeyj 16y agoDidn't NoSQL start in enterprise? Facebook used Cassandra, Google used BigTable, Amazon had Dynamo, etc?
- c00p3r 16y ago0. Because mediocre enterprise programmers can't manage complexity. 0.5. Because you can point fingers to Oracle when it crashes. 0.9. Because "No one was fired for choosing IBM".
- gamble 16y agoNoSQL has technical merits, but it seems to me like a good chunk of the interest in it is driven by distaste for SQL and the complexity of RDB systems in general. There are a lot of programmers out there who shudder at the thought of delving below the ORM, much less writing a stored procedure. Big companies may be many things, but one thing they are not is afraid of RDBMs. Enterprises are filled with the kind of people who dedicate their lives to learning every in and out of Oracle or DB2. Not to mention that these are the people traditional RDBMs products are designed for. They just don't have the same pain points as startups.
- ahi 16y agoThe entire premise is wrong because there is nothing to compare the survey data to. "44% of enterprise users questioned had never heard of NoSQL and an additional 17% had no interest. So why are 61% of enterprise users either ignorant about or uninterested in NoSQL?" Is 61% high or low compared non-enterprise users? Maybe 61% of all users are either ignorant or uninterested. Unrelated, if you're in IT and are unaware of NoSQL databases you kind of suck at your job. Not saying you have to use them, but you should at least know they exist when the tech news is saturated with them.
- CitizenKane 16y agoStonebraker makes a point of saying that the lack of standards in NoSQL system prevents their adoption. While there are standards surrounding SQL most SQL databases do not adhere to the standards. They have connection semantics and syntax that are at times mutually exclusive. Drupal 7 has a dynamic query builder specifically to take care of this (see this podcast for more info http://www.lullabot.com/podcasts/drupal-voices-24-larry-garfield-new-database-layer-drupal-7 http://www.lullabot.com/podcasts/drupal-voices-24-larry-garf...). But for most organizations, it's not like they can simply switch from one database system to another without a fair amount of work.
- kragen 16y agoIt seems to me that there are two or three things being conflated here under the "NoSQL" moniker, and Stonebraker isn't helping things. First, there's the standard relational storage model. We've known for almost 40 years that some kinds of queries are a lot faster if you denormalize so you're not even in 1NF. Occasionally this matters. "Document stores" are a lot better suited to things that aren't in 1NF than relational databases. In theory you could maybe make this problem go away by throwing more hardware at the problem, so that the extra factor of lg N (which might be around 20 or so) goes away. Second, there's SQL and all of the hassles it comes with, which can be largely papered over by things like SQLAlchemy and Django and the like, but there are still tricky issues like schema migration and incremental rollout. Third, there's the CAP theorem. ACID requires consistency (the C in ACID and the C in CAP are the same), so you give up either availability or partitionability, and when you give up partitionability you're usually giving up parallelizability as well, which can put a crimp in the "throw hardware at the problem" approach. It's true that the costs of abandoning standard SQL databases are high. But there are things you can't get any other way. If you need a million queries per second per database server (serving up variable-length lists of structured data), if you need to be able to incrementally roll out a new database schema across your site, or if you need to tolerate network partitions (and latency; a partitioned network is just the limiting case of high latency) without your database becoming unavailable, standard SQL databases aren't going to give you what you need, as far as I know. As far as I can tell, these are the three sources of "NoSQL": rejecting the relational model as a way to organize on-disk storage, rejecting the SQL DDL as a way to manage change, and rejecting ACID transactions. Interestingly, none of these necessarily implies rejecting SQL as a user-interface language, and indeed FQL is an SQL user interface on top of some very non-SQL-ish systems. (SQL itself is a terrible language, as Stonebraker will no doubt tell you if you ask, but it's not so terrible as to justify the switching costs.)
- djhworld 16y agoThe simple reason for all this mess is the fact that most enterprise companies have spent a lot of money on their Oracle/Sybase/Whatever licenses and hardware and want to see a long term return on their capital.
- peterwwillis 16y agoReason #3 is a good one. In Perl i'd make DBDs for all the NoSQL solutions I had to use and tell my devs to use that, but what else could we do that'd be more language-independent?