3 ms·
I always knew the company I work for does cool things with MySQL, but I never knew how far we really have pushed the envelope until I see how much more we push
by dkhenry 14y ago
I always knew the company I work for does cool things with MySQL, but I never knew how far we really have pushed the envelope until I see how much more we push MySQL then the twitters and facebooks of the world. Doing some napkin math I would say our largest cluster of MySQL does about 320 Billion inserts a Day across 80 nodes and some of our nodes can peak at about 200K queries per second ( that would be 16 Million QPS if all the nodes were fully loaded ). Meaning at one of our installs we do the same volume as two facebooks !
- ericcholis 14y agoOut of curiosity, what industry do you work in?
- dkhenry 14y agoPerformance Monitoring.
- ericcholis 14y agoAh, that'll do it.
- aristus 14y agoCoincidently I work on performance monitoring at Facebook. We gave up logging perf data to MySQL because it was a management headache at scale. So instead my colleagues built Scuba, which is essentially a search engine they taught to perform aggregate functions. http://gigaom.com/cloud/exclusive-facebooks-scuba-project-dives-into-performance-data/ http://gigaom.com/cloud/exclusive-facebooks-scuba-project-di...
- dkhenry 14y agoLots of people gave up trying to do their own performance logging, it turns out its a non trivial problem when you get to large scale systems. Which is why the company I work for exists.
- aristus 14y agoDoes the name start with New and end with Relic, by chance? :) I'd love to compare notes sometime. My email's in my profile.
- dkhenry 14y agoNo, but I understand why you might think that. I sent you an E-mail.
- nc17 14y agoYour company is easy to find on Google. It's not stealth, and it's venture-funded. Curious why you can't or won't mention the name here.
- dkhenry 14y agoI am in no way an official spokesperson for them, just a developer, I don't know how much publicity I am allowed to draw to our back end architecture without getting into trouble. It is after all the thing that separates us from everyone else out there. (BTW I have posted the Who's Hiring post a couple times so my Username is pretty easy to track to whom I work for)
- ddorian43 14y agoCurious what type of servers, what type of writes, do you use compression, how you shard, what type of indexes? Write an article for highscalability and get exposure?