4 ms·
I spent a great deal of time writing a recommendation engine for a major web property, so I'll just offer some brief pointers for anyone interested in this stuf
by physcab 16y ago
I spent a great deal of time writing a recommendation engine for a major web property, so I'll just offer some brief pointers for anyone interested in this stuff:
- If you know nothing about how recommenders might work, a good introductory book is Programming Collective Intelligence.
- To do recommendations at scale, your best bet is to write them in java and run them on Hadoop using map/reduce. You can write them in python too I suppose and use Hadoop Streaming.
- NumPy is awesome. Its a great way to prototype your ideas and if you come from a Matlab background (as I did), its very similar. I have not yet run anything in production using NumPy though.
- If you want a recommender that works out of the box, check out Apache Mahout (used with Hadoop) or the Weka project.
- samratjp 16y ago+1. If anyone is interested in map-reduce solutions in python, be sure to check out Yelp's Mr. Job (http://www.readwriteweb.com/cloud/2010/10/yelps-mrjob-powering-recommend.php?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+readwriteweb+%28ReadWriteWeb%29 http://www.readwriteweb.com/cloud/2010/10/yelps-mrjob-poweri...)
- withoutfriction 16y agoIs ruby appropriate for writing recommendation engines? Or is there far more support for writing them in python?
- drats 16y agoAs far as I am aware Ruby has no real equivalent to Numpy and Scipy for Python. This is why I swapped to Python from Ruby; the Ruby community gets extremely thin indeed as soon as you stray from web-related things.
- deleted 16y ago[deleted]
- sandGorgon 16y agohave you looked into using Cascalog/Clojure with hadoop ?