Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
Izkda
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
Izkda
1y ago
> If the user asks about a particular page and Perplexity fetches only that page, then robots.txt has nothing to say about this and Perplexity shouldn’t even consider it That's not what Perplexity own documentation[1] says though: &