3 ms·
The Java/JVM bias is a deficiency of open source Big Data, not bioinformatics!!! FWIW, Google doesn't have a JVM bias in terms of its big data stack, but it st
by chubot 11y ago
The Java/JVM bias is a deficiency of open source Big Data, not bioinformatics!!!
FWIW, Google doesn't have a JVM bias in terms of its big data stack, but it still has langauge biases. Bioinformatics is built on Unix tools and Unix composition AFAICT, and that philosophy needs to make its way back to the big data stack IMO.
My question is what's wrong with what they're doing? If it's working, why not keep doing the same thing, rather than trying to move to Hadoop, which sounds like the wrong tool?
- joergen7 11y ago> The Java/JVM bias is a deficiency of open source Big Data, not bioinformatics!!! I agree. > Bioinformatics is built on Unix tools and Unix composition AFAICT That is true for most bioinformatics tools with a few important exceptions. CummeRbund, e.g., is a must for RNA-Seq and you need to drive it from R. It's hard to tell whether supporting only command line would actually be enough to conveniently describe workflows. For Cuneiform, we assume that it isn't. > what's wrong with what they're doing? It's not that moving to Big Data stacks is the ultimate answer to everything. If your workflow runs fast enough on one machine, probably it's best to change nothing. Nevertheless, we're observing a dramatic drop in sequencing costs right now. And the more this trend continues, the bigger will be the demand for scalable infrastructures in Next Generation Sequencing.