3 ms·

As far as I can tell, Kudu is dominated by Cloudera. They open sourced it as a marketing strategy. Is anyone who isn't paying for CDH using this?

by hapless 10y ago

laserson 10y ago
The Hail project at the Broad Institute makes use of Kudu I believe. https://hail.is https://hail.is Not sure if that group is paying for CDH, but this tool is definitely being built for others to use.
tlipcon 10y ago
Apache Kudu project founder here: It's true that the project was initially developed at Cloudera, and employees continue to be the main driving force behind development. That said, we have committers and contributors from other companies as well. Roughly half the people who contributed a patch in the last 3 months have been non-Cloudera. Additionally we are very strict about doing all development upstream (eg with the first open source release we spent a lot of effort to open the entire development history going back to 2012, including JIRA, git, etc). As for users, here are a couple examples off the top of my head who aren't currently paying for any support: - Xiaomi (world's 4th largest smartphone maker) collects ~2TB/day of event data from >5million phones into a cluster which simultaneously runs analytics workloads (SQL, Spark, etc) - CERN is looking at using Kudu to store high energy physics experiment data from the ATLAS detector at the LHC. You can find some code at https://gitlab.cern.ch/zbaranow/kudu-atlas-eventindex https://gitlab.cern.ch/zbaranow/kudu-atlas-eventindex and a poster here: https://indico.cern.ch/event/505613/contributions/2230964/attachments/1346598/2039266/poster-200.pdf https://indico.cern.ch/event/505613/contributions/2230964/at... (of course lots more too whose names I dont have permission to mention) Feel free to join our slack if you're interested in chatting with more - usually plenty of people online here: https://getkudu-slack.herokuapp.com https://getkudu-slack.herokuapp.com -Todd

As far as I can tell, Kudu is dominated by Cloudera. They open sourced it as a marketing strategy. Is anyone who isn't paying for CDH using this?

by hapless 10y ago

As far as I can tell, Kudu is dominated by Cloudera. They open sourced it as a marketing strategy. Is anyone who isn't paying for CDH using this?

laserson 10y ago

The Hail project at the Broad Institute makes use of Kudu I believe. https://hail.is https://hail.is Not sure if that group is paying for CDH, but this tool is definitely being built for others to use.

tlipcon 10y ago

Apache Kudu project founder here: It's true that the project was initially developed at Cloudera, and employees continue to be the main driving force behind development. That said, we have committers and contributors from other companies as well. Roughly half the people who contributed a patch in the last 3 months have been non-Cloudera. Additionally we are very strict about doing all development upstream (eg with the first open source release we spent a lot of effort to open the entire development history going back to 2012, including JIRA, git, etc). As for users, here are a couple examples off the top of my head who aren't currently paying for any support: - Xiaomi (world's 4th largest smartphone maker) collects ~2TB/day of event data from >5million phones into a cluster which simultaneously runs analytics workloads (SQL, Spark, etc) - CERN is looking at using Kudu to store high energy physics experiment data from the ATLAS detector at the LHC. You can find some code at https://gitlab.cern.ch/zbaranow/kudu-atlas-eventindex https://gitlab.cern.ch/zbaranow/kudu-atlas-eventindex and a poster here: https://indico.cern.ch/event/505613/contributions/2230964/attachments/1346598/2039266/poster-200.pdf https://indico.cern.ch/event/505613/contributions/2230964/at... (of course lots more too whose names I dont have permission to mention) Feel free to join our slack if you're interested in chatting with more - usually plenty of people online here: https://getkudu-slack.herokuapp.com https://getkudu-slack.herokuapp.com -Todd