They can hadoop fs -get it or query it from hive. Because you want to coalesce all your model updates for every pass over the data, the long startup-time for h

They can hadoop fs -get it or query it from hive. Because you want to coalesce all your model updates for every pass over the data, the long startup-time for hadoop jobs actually plays into this. You can have hundreds of millions of samples, in a sparse space of hundreds of millions of parameters, and do it faster on a single node using VW than in a hadoop cluster of equivalent nodes running Mahout.