Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
robotsgz
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
robotsgz
14y ago
Weak argument. Did they give Google "permission" to access the data (and store and republish it)? Google is allowed in robots.txt. But that is not exactly what I would call an agreement. The simple fact is this info is on the public web w
2.
▲
by
robotsgz
14y ago
Not sure I would call that ingenious. But your point is sorely need of being made more often. How many other websites use arguments like "bandwidth" to falsely portray competitors who access their publicly shared data as somehow in the wro