3 ms·

I regularly use https://www.justwatch.com https://www.justwatch.com for looking up movies. But its scraping abilities leave a lot to be desired; they are often

I regularly use https://www.justwatch.com https://www.justwatch.com for looking up movies. But its scraping abilities leave a lot to be desired; they are often wrong. And the data is not very transparent (e.g. historical data). I have considered creating an alternative. And have the client choose the streaming services they have like JustWatch. However, for unavailable movies, have a "I'd watch this if it were streaming for me" button. Then I'd record the cross-section of that user's streaming services and their request and keep public counters. I'd remove all users votes if that movie became available for any of their streaming options. I'd show votes for movie per streaming subscription service. Also, in the interest of transparency, I'd keep a running history of when movies came and went from providers. I'd also scrape TV guide to see when they are on TNT or whatever. This is the type of data people deserve. Aside: JustWatch people, I know you browse HN...you can steal this idea and monetize it by, instead of being nice like me and making the votes transparent, just keep the counters internal and sell them as data points. You can couple it into a "I'd watch this! Notify me when this movie is available" feature.

dewey 9y ago
> But its scraping abilities leave a lot to be desired; they are often wrong. If you spot any mistakes, especially ones that are consistent and happen frequently (wrong price on a provider,...) feel free to email us at data-police@justwatch.com and we'll take a look. We are very responsive when it comes to that and are constantly improving our scraping infrastructure to stay as accurate as possible. Unfortunately it'll always be a bit of catching up if you scrape hundred of third party providers in more than 30 countries that constantly change their APIs or websites :) As for the "notification" system. That's definitely something that we think about, stay tuned! Disclaimer: I work on the JW scraper
- kodablah 9y ago
  By "often wrong" above, I should clarify that I find maybe a mistake a week browsing hundreds. I don't want to give anyone the wrong impression that it is wrong most of the time or anything. I do report incorrections through the app. I love the feature that allows me to put in my email to get notified when the issue is fixed, I wish more companies did this (granted I only put my email on a small percentage of the issues I find). To date, I have not seen anything systemic though.
- ascorbic 9y ago
  Filtering by Metacritic scores please! They're more useful than Rotten Tomatoes for TV shows.

dewey 9y ago

> But its scraping abilities leave a lot to be desired; they are often wrong. If you spot any mistakes, especially ones that are consistent and happen frequently (wrong price on a provider,...) feel free to email us at data-police@justwatch.com and we'll take a look. We are very responsive when it comes to that and are constantly improving our scraping infrastructure to stay as accurate as possible. Unfortunately it'll always be a bit of catching up if you scrape hundred of third party providers in more than 30 countries that constantly change their APIs or websites :) As for the "notification" system. That's definitely something that we think about, stay tuned! Disclaimer: I work on the JW scraper

kodablah 9y ago
By "often wrong" above, I should clarify that I find maybe a mistake a week browsing hundreds. I don't want to give anyone the wrong impression that it is wrong most of the time or anything. I do report incorrections through the app. I love the feature that allows me to put in my email to get notified when the issue is fixed, I wish more companies did this (granted I only put my email on a small percentage of the issues I find). To date, I have not seen anything systemic though.
ascorbic 9y ago
Filtering by Metacritic scores please! They're more useful than Rotten Tomatoes for TV shows.