4 ms·
Put up or shut up (I don't mean this in a mean way... read on). There is a great data set to test this theory... Netflix. This article shouldn't end by just s
by kenjackson 16y ago
Put up or shut up (I don't mean this in a mean way... read on).
There is a great data set to test this theory... Netflix. This article shouldn't end by just solicitng opinions, but with his results in the Netflix data set.
- xamat 16y agoHi @kenjackson, this is Xavier here. How do you propose to validate this on the Netflix dataset? It is clear that you cannot use RMSE to compare to other existing approaches, right? The way to go would be to propose a different success measure (i.e. ranking based) and measure how different algorithm perform. And then validate this on users to prove that optimizing RMSE is not as useful. If you give me a few months, I might get there. But this is the reason I wrote a blog post and not a paper ;-)
- frak_your_couch 16y agoI just wanted to point out that the link on your blog to PureSVD points to the wikipedia page for Discounted Cumulative Gain.
- xamat 16y agoOOps! Thanks... just fixed it.
- frak_your_couch 16y agoHey, sorry, one more time. The updated link is also wrong, it's relative to your blog rather than absolute i.e. http://technocalifornia.blogspot.com/2011/04/research.yahoo.com/files/recsys2010_submission_150.pdf http://technocalifornia.blogspot.com/2011/04/research.yahoo.... as opposed to http://research.yahoo.com/files/recsys2010_submission_150.pdf http://research.yahoo.com/files/recsys2010_submission_150.pd...
- xamat 16y agoOh man... damn blogger. Fixed it now... finally! Thanks!!!
- kenjackson 16y agoIf you give me a few months, I might get there. But this is the reason I wrote a blog post and not a paper ;-) Fair enough. I'll keep my eyes peeled for a paper in a few months. :-)