2 ms·
Yes. it can. Scikit-learn supports algorithms that can be used to build your own recommender system. To scale your algorithms you can always use hadoop map/redu
by SoCool 14y ago
Yes. it can. Scikit-learn supports algorithms that can be used to build your own recommender system. To scale your algorithms you can always use hadoop map/reduce to scale.
- axiak 14y agoOnce you use scikit-learn to figure out what you want to do on a reasonable data set, you can use Mahout (http://mahout.apache.org/ http://mahout.apache.org/) to translate the algorithm to hadoop pretty easily.
- ogrisel 14y agoYou should directly use Mahout: the recsys part is quite complete and high level and application oriented contrary to scikit-learn which does not provide high level recsys concepts. The best documentation I found is the Mahout in Action book (http://manning.com/owen/ http://manning.com/owen/) while reading the source code in parallel. Also you probably don't need to run this on a Hadoop cluster unless your data is too big to fit on one single machine.