Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
gorbog
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
gorbog
7y ago
How can they crawl the entire web ( or a big portion of it) everyday without spending tens of thousands of dollars in server / bandwidth costs? I know there are lots of open source crawlers like Stormcrawler and all, but the cost of ru