4 ms·
How would this stop crawling by users who cannot afford the API subscription or don't want to pay for it? I think your suggestion would reduce crawling, but no
by vivekseth 9y ago
How would this stop crawling by users who cannot afford the API subscription or don't want to pay for it?
I think your suggestion would reduce crawling, but not prevent or block it.
- odammit 9y agoBuild a revshare API. I assume the people that can't afford it are using it for non-revenue generating purposes. I don't know that I'd care about those people if they aren't taking away from my bottom line.
- sushid 9y agoBecause you'd presumably need to authenticate (and have a paid account) to access the data.
- odammit 9y agoI think they meant, since they can't afford the API, they'd just keep crawling your HTML. Combo move the API and putting your stuff behind auth and you solve a lot of the problem. You've gotta get that good yummy content publicly accessible for google though, so you'll rank. So, that's a balancing act.