Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
o0Oo0O
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
o0Oo0O
13y ago
How about using Crawl-delay at robots.txt? http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl...
2.
▲
by
o0Oo0O
13y ago
Was there a reason for not doing MVP? You could have made it easy to publish and scrap everything else.