3 ms·
Lemme mass scrape facebook and linked in then ;)
by novok 6y ago
Lemme mass scrape facebook and linked in then ;)
- spaced-out 6y agoCourts have already said you can https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn
- MattGaiser 6y agoIf you can get away with it, you can.
- jandrese 6y agoThe only thing stopping you is Facebook's tech team. It's basically an arms race between the scrapers and anti-scraping tech.
- asdff 6y agoIt is so frustrating how many brilliant minds on either side are just wasted fighting this bullshit war and countless others like it for someone else's bonus check. There are so many hard engineering problems that need to be solved, and it's depressing how we as a society reward who can sell the most widgets instead of who can help the most people.
- jtsiskin 6y agoIf you can figure out how to align incentives, you can save the world
- agogdog 6y agoI've tried for various reasons, they apparently have a team to fight scraping so it's a game of rate-limit whack-a-mole. This is a decent example of the imbalance of power too... Facebook could probably scrape whatever they want with little resistance from average sized sites... if they really wanted to they could put a team of skilled engineers on a team to get it. On the other end, if you want to scrape Facebook you're staring down a team of skilled engineers that's actively trying to prevent you from doing much. At this point in technology they're more formidable than most countries.
- pocket_cheese 6y agoScraping facebook has been one of my dreams. I remember taking a cursory crack at it and giving up after seeing how much of time, money and effort it would involve. The cost of storing the data alone would be cost prohibitive, even if you have a fancy FAANG salary. Scraping facebook is an operation. One I wish to make happen one day :D