10 ms·
Four DB2 Code Bases?
- gaius 9y agoBecause DB2, like Watson, is an overall brand name for a suite of products. This is a standard IBM practice.
- yeukhon 9y agoI am just going to drop a few quick comments. It's 6:39AM in NY, and I just woke up. Maybe not relevant at all, but... I love reading about biography like these. I own a couple books, for example, "Where Wizards Stay Up Late: The Origins Of The Internet" did keep me awake for a few days on an early train. This one, absolutely easy to digest, thank you for sharing. 1. So do the four code bases share code they reuse (think of a common repository they depend on)? 2. Are the query planners all different because they needed to be platform specific? 3. Is DB2 still on four code bases? Would be awesome if we have one central catalog of stories like this one. BTW, I didn't know much about the author, so I did some quick googling: http://mvdirona.com/jrh/work/ http://mvdirona.com/jrh/work/ (I hope HN won't flood it to 404! Mr. James, is this on AWS!? It looks like it might be.)
- paulie_a 9y agoTotally off topic but I just grabbed that book of my shelf to reread over the holidays while traveling
- yeukhon 9y agoCommentary: totally too many names to keep track of so to future readers, my adivce is avoid a long gap between each reading. But it is fun to learn all the names and what was going on at that time.
- jhalstead 9y agoIf you have time to list the other books that you own like this and "Where Wizards Stay Up Late: The Origins Of The Internet", I'd definitely appreciate it. I love reading these types of stories too!
- lobster_johnson 9y ago"Showstopper!: The Breakneck Race to Create Windows NT and the Next Generation at Microsof" by G. Pascal Zachary is great, about an interesting period of Microsoft's life.
- krylon 9y agoNot sure if it fits your bill, but I found "I Sing The Body Electronic" by Fred Moody a very interesting read. Moody was able to get some pretty intimate insights into the development of a software product at Microsoft at the beginning of the 1990s (1992-1993, I think). I was surprised to learn afterwards that Moody had (has?) a reputation for being very pro-Microsoft; this book does not embellish the problems the people on the project team face, nor their conflicts.
- segmondy 9y ago"We were burning: Japanese Entrepreneurs And The Forging Of The Electronic Age"
- polarix 9y agoI liked "The Friendly Orange Glow: The Untold Story of the PLATO System and the Dawn of Cyberculture" which sounds related... I hadn't heard about PLATO before, and the book was strongly redolent of "online culture".
- yeukhon 9y agoI will add as well: "The Chip: How Two Americans Invented the Microchip and Launched a Revolution"
- guitarbill 9y agoI have a lot of respect for databases in general, and DB2 is no different. But if you've ever tried to install DB2, you'll know it's a monstrosity, and even internally it was hard to get a license. The result of this is that most IBMers I know would rather use e.g. Postgres for other projects, not DB2. Now I'm not silly enough to think Postgres will replace DB2 at e.g. banks, but the effect is that Postgres reputation and knowledge spreads, and DB2 reputation and knowledge die. In the long run, I think this is a good thing. Also, if you read between the lines, there's a ludicrous amount of infighting in IBM, which is probably how they ended up with four code bases. Still happens to this day.
- gaius 9y agoNow I'm not silly enough to think Postgres will replace DB2 at e.g. banks You might be surprised then, because that's not silly at all. DB2 may hang on in the Back Office, the least technically sophisticated bit of banking for various reasons for a while longer, but it's long gone from the Front Office and Postgres is one of the replacements. I don't think anyone is starting new projects on DB2 even in BO.
- ghshephard 9y agoAre there any databases successfully in production in high-value transactional environments other than oracle or DB2? I have to believe a lot of the pain coinbase is experiencing stems from their decision to use mongodb - which I love and use daily, but would never, ever have chosen over Oracle for high transaction bitcoin exchange. I wonder if anybody has done a write up on this oracle/db2 versus “others” in the super-high-value back office scenario.
- BrentOzar 9y agoThe timing of the post is interesting given Microsoft SQL Server 2017's new support for Linux. Microsoft's doing it with one code base to span Windows, Linux, and Azure SQL DB, and it's interesting to read why IBM took a different route. My favorite line out of it: "so I ended up taking a long weekend and writing support for a primitive approach to supporting greater-than-2GB tables." Wow.
- whatusername 9y agoI'm fairly sure that DB2 for LUW (Linux/Unix/Windows) likely counts as a single code base. And I imagine that's x86 and power (and maybe Sparc? probably big or little endian. And support for Solaris, Aix, etc). It's the esoteric platforms like mainframe or as/400 that need custom code bases
- megaman22 9y agoThat line is especially great in the context of the preceding paragraph: > At the time I was lead architect for the product and felt super-strongly that we needed to address the table size limitation of 2GB before we shipped. I was making that argument vociferously but the excellent counter argument was we were simply out of time. Any reasonable redesign would have delayed us significantly from our committed product ship dates. Estimates ranged from 9 to 12 months and many felt bigger slips were likely if we made changes of this magnitude to the storage engine. >I still couldn’t live with the prospect of shipping a UNIX database product with this scaling limitation so I ended up taking a long weekend and writing support for a primitive approach to supporting greater-than-2GB tables. It's amazing how often one person with a solid grasp of a problem can run circles around teams that are shackled by process and cya and politics.
- pavlov 9y agoDb2 for z/OS will live on for the life of the IBM mainframe ... This raises a question which is interesting to me (not knowing anything about mainframes). How long is the life of the IBM mainframe going to be? Are there specific plans already in place to replace these systems on a known schedule? Or are they going to be around indefinitely?
- delinka 9y agoI suggest they’ll be around indefinitely. While large customers are willing to spend large sums of money to maintain their systems and avoid the risks of new technology upgrades, IBM will continue to serve those customers.
- AstroJetson 9y agoI agree, mainframes will live forever. Companies are always coming up with new loads and ways to use them. I (kiddingly) poke at the people at work that I'm starting to teach my 6 year old grand child COBOL and CICS, they will have lifetime employment.
- 0x445442 9y agoMy inclination is to agree but I work for a bank and we're in process of replacing all systems hosted on our mainframes. Will we ever get there is another question but that's the current road map.
- mseebach 9y agoForever is such a long time. There are no new projects started on mainframes and there's a definite, if still quite flat, trajectory towards moving things off the mainframe. So eventually it will die, but it will be decades.
- delinka 9y agoAs we approach the limit (of zero) that tail will just continue to get longer and longer. And by “indefinite” I do not mean “forever.” I mean that there’s no definite date that the ‘mainframe industry‘ will end— IBM hasn’t published any roadmap to end their use, and many institutional users are happy making few changes to business operations.
- CrLf 9y agoThe article mentions Informix, which has also been an IBM product for a number of years now. That makes it at least five major RDBMS code bases inside IBM. I spent a few years managing DB2 instances at a previous employer and I've seen it hold its own against mixed workloads (i.e. shitstorms of bad-behaved applications and people running ad-hoc queries) that I don't think even a well tuned PostgreSQL could handle today. DB2 has some really annoying quirks(1) and that IBM'ish feel that's very hard to explain, but it's also very understandable (from a tuning perspective) for such a complex piece of software. DB2 for Windows seemed mostly crap compared to Linux or AIX, though. (1) For example, at least since I've last looked into it, DB2 had no decent MVCC(2) and it was a real pain to deal with all the lock-related problems that would arise from large write/update transactions running in parallel with small reads. (2) At some point (9.5, IIRC) they tried to simulate MVCC by letting transactions read previous row versions from the transaction log. This seemed to come with its own set of significant drawbacks.
- barake 9y agoInformix is a pretty great database. Much like you mentioned with DB2, it can take really varied workloads on the same database and keep on trucking. Just requires some basic indexing, no need to carefully tune to a particular use case. The best part is how resource light it is. I was using Informix on a dual 200mhz HP K class box until about 8 years ago. HP literally just gave us a RP3440 to get us off it...
- gaius 9y agoI've only done one real project on Informix but I really enjoyed it. The Informix culture is great, all the DBAs seem to be former C programmers who happily write their own utilities in C where other DBAs would have used Perl or something.
- DrScump 9y agoTwo of IBM/Informix's top engineering guys started at Informix itself in the 1980s and are still there now with IBM; one even left Google to return. I worked with both for years.
- spenczar5 9y agoI’m one of those youngish programmers who has never really worked on anything but Linux, so the idea of these IBM operating systems is pretty foreign to me. The article describes System i as “very advanced” but I have never even really heard of anyone using it or referencing it. How do you write and deploy software for these things? I am so used to just being able to, like, build a Go binary and run it on a Linux box. Are they better in some ways that I am missing out on? Just curious.
- trollopTheJope 9y agoif you can't just build your Go binary and run it on your Linux box, is it even, like, worth knowing? I'll bet the author hasn't even heard of Go or Linux boxes, like. "very advanced"? according to, like, whom? /me resumes hacking go program on linux box
- bluedino 9y agoZend has a full PHP environment for the i, and you can install things like Apache and MySQL on it. You can even virtualize Linux on it. Most older programs are written in RPG but there are ways to write programs in other language like C or COBOL. You can use tools like IBM VisualAge to have a "modern" environment instead of hammering away at green screen text terminals. It's a very odd environment, unlike both Windows and UNIX. There is a job scheduler, output queues, print devices, security levels, objects... Check out the young i developers group if you want to learn more. They embrace modern tech like node and github http://yips.idevcloud.com/wiki/ http://yips.idevcloud.com/wiki/
- snuxoll 9y agoIBM i is advanced in some interesting ways, but the design has plenty of drawbacks. The database (DB2) is baked right into the operating system and is an integral component virtually every application relies on it - you can access tables via SQL or directly through record access (equivalent to fopen(), but against database tables). In fact, the “traditional” UNIX like filesystem (the IFS) on IBM I is an entirely different world, the object storage subsystem (the database) is where 99% of everything live on IBM I including most applications. Applications aren’t compiled to machine code directly, outside the lowest level code needed to get the system running - they’re all stored as bytecode and compiled to machines code on first run, which is how IBM has taken advantage of newer POWER releases without requiring customers beg vendors to upgrade or rebuild their code. There’s a hell of a lot more, but these are two key components of the design. As for writing software, you basically have no choice but to use tooling IBM has support for. There is a emulated POSIX environment (PASE) but it’s mostly used by IBM to port things from AIX - the traditional IBM i languages are RPG plus C/C++ as a newer addition, but they have runtimes for Java, Python, Node and a few others. The traditional languages are the only way you have to make classic green screen apps, while the latter are there primarily to host web applications.