3 ms·
That's indeed a good idea. It does not solve one real issue with recommendation, though: the objective measure is whether people buy more stuff, which means run
by cdavid 16y ago
That's indeed a good idea. It does not solve one real issue with recommendation, though: the objective measure is whether people buy more stuff, which means running experiments not only on real data but in the real business environment.
- izendejas 16y agoRight, the cost functions could be defined in terms profit maximization (thus, the cost being lost sales, eg). Either way, these experiments are very difficult to control because you can't fully validate models by predicting sales a posteriori with holdouts once you have the data as you don't know if some algorithm might influence certain sales not reflected in such real-life data. You could try a/b testing, but I'm not sure the Amazons are willing to run someone's models very readily. Either way, this is a good thing.