4 ms·

(Reposting, again, with permission from dang) Hi, OP here. I started working on recommender systems in 2016 during my undergrad, specifically doing music recom

(Reposting, again, with permission from dang) Hi, OP here. I started working on recommender systems in 2016 during my undergrad, specifically doing music recommendation (I was dissatisfied with the quality of Pandora/Spotify recommendations). I spent about five months in 2019 trying to make a music startup based on that. However, during that time I realized that there would probably be more value in having a really good general-purpose/cross-domain recommender system. i.e. if you're looking for something specific, use Google, and if you're not looking for something specific, use Findka. That's the vision anyway.[1][2] More specifically, the benefits I see from cross-domain recommendation are: - More data per user => better recommendations. - More potential users => (eventually) better recommendations. For example, to get users for a podcast recommender, you have to find people who like podcasts above a certain threshold. With Findka, anyone who's interested in getting recommendations for at least one content type is a potential user. (And even people who aren't above that threshold for podcasts might appreciate an occasional podcast recommendation). - Lots of potential applications. I'm particularly interested with trying to use Findka for social networking (opt-in of course). Data from Findka could be useful for dating, job opportunities, forming online communities, etc. This is more long-term, but I also think Findka data could be useful for search.[3] The algorithm currently is dead simple. Just collaborative filtering without explicitly taking into account content type. So it's naively cross-domain. Since the data set is still small, there's no need for matrix factorization. I recompute the whole matrix every hour and store it in memory. See [4] for the implementation (it only took 30 LOC). That's a little out-of-date but the general approach hasn't changed. For the tech stack, I'm using a Clojure web framework + deployment solution that I made.[5] It's like a self-hosted version of Firebase (I'm running it on DigitalOcean). [1] https://www.ben-evans.com/benedictevans/2015/6/24/search-dis... https://www.ben-evans.com/benedictevans/2015/6/24/search-dis.... [2] https://www.aaai.org/ojs/index.php/aimagazine/article/view/2... https://www.aaai.org/ojs/index.php/aimagazine/article/view/2.... [3] https://news.ycombinator.com/item?id=23449754 https://news.ycombinator.com/item?id=23449754 [4] https://findka.com/blog/rec-sys-in-30-lines/ https://findka.com/blog/rec-sys-in-30-lines/ [5] https://findka.com/biff/ https://findka.com/biff/

jfengel 6y ago
I do think the idea has a lot of merit. I've seen collaborative filtering work very well in movie recommendations, and I've observed in real life how often social groups overlap with multiple similar interests. I think that scaling will be a challenge, both computationally and gathering enough data to be meaningful. The biggest wins, I suspect, are when you can infer people's preferences incidentally (say, from watching what podcasts they actually talk about on social media) rather than from their self-reported preferences, where conscious intentions often override true emotions. But I'd love to see this work. I know there are things out there that I'd enjoy but don't manage to connect with.
- jacobobryant 6y ago
  I've thought a fair amount about inferring preferences (i.e. explicit vs. implicit feedback). Particularly for music, tracking skip data and feeding recommendations to the music player would make it a lot more convenient. My plan is to integrate more deeply with specific content types as time goes on/after the business is working.
arcticfox 6y ago
Very cool and nice vision statement! Quick heads up, the book links aren't working for me.
- jacobobryant 6y ago
  Thanks for the heads up. Turns out the default url that google books returns often gives a 404. I fixed that last night but haven't updated all the previously imported books yet.
xerox13ster 6y ago
> I started working on recommender systems in 2016 during my undergrad, specifically doing music recommendation (I was dissatisfied with the quality of Pandora/Spotify recommendations). I spent about five months in 2019 trying to make a music startup based on that. Hi! I'm very interested in this domain, I have long been dissatisfied with the results for music recommendation across almost every platform (and the respective apps, but I digress). So frequently it seems my own personal preferences are washed away in the breadth of ML and algorithmic recommendation systems, that no matter what I begin listening on, I will invariably find myself within the mainstream for that genre/artist. It also seems to me that many algorithms can't properly deduce that I would want songs centered around a specific year, and instead seem to draw from what's "popular" in the genre regardless of the time period the song is starting from. As an example, I can begin a GPM station based on I Gotta Feeling, a song from 2009. When I start a playlist like that, I nearly never am rewarded with a song from that time period. I tried it just now, it immediately jumped to Roar by Katy Perry, a song from 2014 with an entirely different vibe. I supposed my question is, how meaningful are the music recommendations Findka produces? I would love to talk more about the music startup you were pursuing, and what you accomplished there, as well as any roadblocks you may have faced. I have been whittling down an idea for a music startup myself and can't help but wonder where that road led for you. Also your site link is broken/not resolving.

jfengel 6y ago

I do think the idea has a lot of merit. I've seen collaborative filtering work very well in movie recommendations, and I've observed in real life how often social groups overlap with multiple similar interests. I think that scaling will be a challenge, both computationally and gathering enough data to be meaningful. The biggest wins, I suspect, are when you can infer people's preferences incidentally (say, from watching what podcasts they actually talk about on social media) rather than from their self-reported preferences, where conscious intentions often override true emotions. But I'd love to see this work. I know there are things out there that I'd enjoy but don't manage to connect with.

jacobobryant 6y ago
I've thought a fair amount about inferring preferences (i.e. explicit vs. implicit feedback). Particularly for music, tracking skip data and feeding recommendations to the music player would make it a lot more convenient. My plan is to integrate more deeply with specific content types as time goes on/after the business is working.

arcticfox 6y ago

Very cool and nice vision statement! Quick heads up, the book links aren't working for me.

jacobobryant 6y ago
Thanks for the heads up. Turns out the default url that google books returns often gives a 404. I fixed that last night but haven't updated all the previously imported books yet.

xerox13ster 6y ago

> I started working on recommender systems in 2016 during my undergrad, specifically doing music recommendation (I was dissatisfied with the quality of Pandora/Spotify recommendations). I spent about five months in 2019 trying to make a music startup based on that. Hi! I'm very interested in this domain, I have long been dissatisfied with the results for music recommendation across almost every platform (and the respective apps, but I digress). So frequently it seems my own personal preferences are washed away in the breadth of ML and algorithmic recommendation systems, that no matter what I begin listening on, I will invariably find myself within the mainstream for that genre/artist. It also seems to me that many algorithms can't properly deduce that I would want songs centered around a specific year, and instead seem to draw from what's "popular" in the genre regardless of the time period the song is starting from. As an example, I can begin a GPM station based on I Gotta Feeling, a song from 2009. When I start a playlist like that, I nearly never am rewarded with a song from that time period. I tried it just now, it immediately jumped to Roar by Katy Perry, a song from 2014 with an entirely different vibe. I supposed my question is, how meaningful are the music recommendations Findka produces? I would love to talk more about the music startup you were pursuing, and what you accomplished there, as well as any roadblocks you may have faced. I have been whittling down an idea for a music startup myself and can't help but wonder where that road led for you. Also your site link is broken/not resolving.