3 ms·

Can anyone comment on using this vs http://prediction.io/ http://prediction.io/ ?

• mrgordon 12y ago
  I ran data through both services a few weeks ago. Both claimed the same accuracy on cross-validation but the prediction.io interface showed the classifier was performing very poorly on the sample predictions that they display. Sure enough, it continued to do poorly when I tried it on new examples. The Google classifier generalized well and continued to get the same accuracy. This is obviously just one anecdote but it did turn me off a bit. That said, some of the constraints on the Google API are pretty lame (e.g. the same word with different capitalization is treated as two separate words so you have to downcase everything). We ended up writing our own grid search across classifiers and set up our own web service for using it that has a much nicer API and more tolerance for real world input formats.
  • alexirobbins 12y ago
    Prediction.io is just an interface on top of Apache Mahout. The results appear to be the same: mediocre.
    • thawab 12y ago
      They switched from Mahout to Spark a while ago. Two days ago Apache Mahout announced that the new version is using an Apache Spark back-end. http://www.reddit.com/r/MachineLearning/comments/31yj71/apache_mahout_010_release/ http://www.reddit.com/r/MachineLearning/comments/31yj71/apac...
      • mrgordon 12y ago
        oh wow they integrated H2O as well. really interesting developments!