5 ms·

Does GitHub use Percona or MariaDB? We (https://commando.io https://commando.io) switched to Percona, mainly to use their Xtrabackup feature which can do stream

Does GitHub use Percona or MariaDB? We (https://commando.io https://commando.io) switched to Percona, mainly to use their Xtrabackup feature which can do streaming type backups without bringing MySQL to its knees. Also, Percona supports an awesome custom configuration option: thread_handling=pool-of-threads http://www.percona.com/doc/percona-server/5.5/performance/threadpool.html http://www.percona.com/doc/percona-server/5.5/performance/th...

samlambert 12y ago
I have tested thread pooling with our workload and it didn't go so well. Also > Note This feature implementation is considered BETA quality.
- nodesocket 12y ago
  Interesting, love to see your results some day. How are you doing backups? I assume you are not just using mysqldump?
  - samlambert 12y ago
    Both Xtrabackups and mysqldump for logical backups.
- 15characterlimi 12y ago
  Are you using Percona XtraDB Cluster?
  - samlambert 12y ago
    Nope.
nrbafna 12y ago
Do you some figures around improvement from changing thread_handling to a pool instead of one per thread? The queries on my db server, fit the documented use case for this feature - lots of short live queries.
- morgo 12y ago
  The analogy I would use for thread-pool is to insert a waiter in front of the chefs in the kitchen. It doesn't make sense for all workloads, but I have found thread pool to be useful in cases where application servers can overload database servers (either via misconfigured connection pooling, or no pooling). An example where it might make less sense: a dedicated worker queue running in N threads connecting to MySQL.
morgo 12y ago
It is worth mentioning that commercial distributions of MySQL feature pool-of-threads as well. Percona Server features what is essentially a re-implementation: http://dev.mysql.com/doc/refman/5.5/en/faqs-thread-pool.html http://dev.mysql.com/doc/refman/5.5/en/faqs-thread-pool.html
Thaxll 12y ago
Why won't you use the Oracle version? atm MariaDB isn't a replacement for the stock version of MySQL.
- toomuchtodo 12y ago
  MariaDB is a drop-in replacement for stock MySQL. It's performance is actually better than MySQL. https://mariadb.com/kb/en/mariadb/mariadb-vs-mysql-compatibility/ https://mariadb.com/kb/en/mariadb/mariadb-vs-mysql-compatibi...
  - Thaxll 12y ago
    MySQL has years of proved stability, the performance is BS, one graph means nothing, it's like all the people saying they're running thousands of QPS on a server, you just don't know the benchmark and the type of queries running. I can run 3k SELECT in cache... I'm sure one day MariaDB will replace stock MySQL but clearly it's not ready yet. btw Oracle is doing a good job with MySQL atm.
    - deleted 12y ago
      [deleted]
    - heavenlyhash 12y ago
      My bets are all squarely on MariaDB. MySQL under Oracle is stymied by conflicts of interest. One concrete example is hashjoins, a fairly simple and efficient strategy for many general purpose workloads: MariaDB supports hashing as a join strategy since 5.3/5.5 [1] back in 2011. MySQL, to the best of my knowledge, still lacks any implementation of this. OracleDB, of course, supports hash joins. Oracle has every incentive not to implement hash joins in MySQL because hash joins are one of the performance features that they use to drive sales of OracleDB. [1] https://mariadb.com/kb/en/mariadb/what-is-mariadb-53/#join-optimizations https://mariadb.com/kb/en/mariadb/what-is-mariadb-53/#join-o...
    - sjwright 12y ago
      > Oracle is doing a good job with MySQL atm. Obvious troll is obvious. > the performance is BS We're extremely happy with our "BS" performance.
walden42 12y ago
Why not just run backups on a replica suited specifically for that purpose?

samlambert 12y ago

I have tested thread pooling with our workload and it didn't go so well. Also > Note This feature implementation is considered BETA quality.

nodesocket 12y ago
Interesting, love to see your results some day. How are you doing backups? I assume you are not just using mysqldump?
- samlambert 12y ago
  Both Xtrabackups and mysqldump for logical backups.
15characterlimi 12y ago
Are you using Percona XtraDB Cluster?
- samlambert 12y ago
  Nope.

nrbafna 12y ago

Do you some figures around improvement from changing thread_handling to a pool instead of one per thread? The queries on my db server, fit the documented use case for this feature - lots of short live queries.

morgo 12y ago
The analogy I would use for thread-pool is to insert a waiter in front of the chefs in the kitchen. It doesn't make sense for all workloads, but I have found thread pool to be useful in cases where application servers can overload database servers (either via misconfigured connection pooling, or no pooling). An example where it might make less sense: a dedicated worker queue running in N threads connecting to MySQL.

morgo 12y ago

It is worth mentioning that commercial distributions of MySQL feature pool-of-threads as well. Percona Server features what is essentially a re-implementation: http://dev.mysql.com/doc/refman/5.5/en/faqs-thread-pool.html http://dev.mysql.com/doc/refman/5.5/en/faqs-thread-pool.html

Thaxll 12y ago

Why won't you use the Oracle version? atm MariaDB isn't a replacement for the stock version of MySQL.

toomuchtodo 12y ago
MariaDB is a drop-in replacement for stock MySQL. It's performance is actually better than MySQL. https://mariadb.com/kb/en/mariadb/mariadb-vs-mysql-compatibility/ https://mariadb.com/kb/en/mariadb/mariadb-vs-mysql-compatibi...
- Thaxll 12y ago
  MySQL has years of proved stability, the performance is BS, one graph means nothing, it's like all the people saying they're running thousands of QPS on a server, you just don't know the benchmark and the type of queries running. I can run 3k SELECT in cache... I'm sure one day MariaDB will replace stock MySQL but clearly it's not ready yet. btw Oracle is doing a good job with MySQL atm.
  - deleted 12y ago
    [deleted]
  - heavenlyhash 12y ago
    My bets are all squarely on MariaDB. MySQL under Oracle is stymied by conflicts of interest. One concrete example is hashjoins, a fairly simple and efficient strategy for many general purpose workloads: MariaDB supports hashing as a join strategy since 5.3/5.5 [1] back in 2011. MySQL, to the best of my knowledge, still lacks any implementation of this. OracleDB, of course, supports hash joins. Oracle has every incentive not to implement hash joins in MySQL because hash joins are one of the performance features that they use to drive sales of OracleDB. [1] https://mariadb.com/kb/en/mariadb/what-is-mariadb-53/#join-optimizations https://mariadb.com/kb/en/mariadb/what-is-mariadb-53/#join-o...
  - sjwright 12y ago
    > Oracle is doing a good job with MySQL atm. Obvious troll is obvious. > the performance is BS We're extremely happy with our "BS" performance.

walden42 12y ago

Why not just run backups on a replica suited specifically for that purpose?