We aren't looking at robots.txt - but that's a great suggestion. It leads to a bigger point about bad actors. Unfortunately, people can build bots to do all ki

We aren't looking at robots.txt - but that's a great suggestion. It leads to a bigger point about bad actors. Unfortunately, people can build bots to do all kinds of bad things - this is something we have seen, considered and taken some steps to mitigate. Right now, we have a low level query, with follow-up manual inspection, to prevent bad actors. (Shout-out to our YC batchmates who alert us https://beta.useavenue.com/ https://beta.useavenue.com/). For example, we detected bots being used for harassment on social media and stamped it out. It's possible for us to scale this up for similar 'bad use-cases' like the one you've identified.