4 ms·
Dwell is a very powerful ranking signal in a binary classifier. Pairwise association of videos watched by the same user consecutively or even just sampled pair
by benreesman 6y ago
Dwell is a very powerful ranking signal in a binary classifier.
Pairwise association of videos watched by the same user consecutively or even just sampled pairs from their last N videos will get you a video embedding.
Pairwise sampling of users who watch the same video to the end will get you a user embedding.
Turking category tags will prime the pump for other types of embeddings.
These things can be ensembles, stacked, force learned jointly, etc.
All of this comes out of the box in Keras (though it’s up to you to feed the data in fast when you’ve got a lot office).
You can argue that getting latent representations/factorizations without explicit “user clicked show me more” is semi-supervised I guess, but if so all the recommender stuff since the Netflix Challenge meets that criteria to one degree or another.
- londons_explore 6y agoWhat surprises me is all of what you've said is the way pretty much all recommenders work - YouTube, Facebook, Twitter, etc. will all be doing this. Yet people don't spend hours per day browsing tweets. What is it about tiktok which is so much more effective?
- lalos 6y agoYou don't have that equivalent signal, that's what matters. i.e. Twitter doesn't know if you even finished reading the tweet which is what is providing a strong signal in the case of TikTok, skipped vs watched once vs watched multiple times.
- hooande 6y agoI spend hours per day browsing tweets. Nothing about this algorithm seems to be groundbreaking. TikTok has a strong brand and is benefiting from that
- SergeAx 6y agoFacebook and Twitter are social-graph subscription-based services. TikTok just gives recomendations without subscriptions while knowing nothing about my social graph.
- disgruntledphd2 6y agoWell, except for follows, right? But yeah, it appears (from TikTok's success) that the social graph may not be particularly useful for content-based recommendation (which really, we should probably have realised given the existence of Google).