Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
nmlracx
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
nmlracx
3y ago
It seems to me that Twitter's robots.txt only allows Googlebot: https://twitter.com/robots.txt Therefore, this disallows other bots in "maschinenlesbarer Form" and the scraping is illegal.