4 ms·
Playing around with the UI, I cannot see where that depth would be set. Is it not a per-datasource variable? Is the "scrape linked pages" configured to be "san
by ComputerGuru 2y ago
Playing around with the UI, I cannot see where that depth would be set. Is it not a per-datasource variable?
Is the "scrape linked pages" configured to be "sandboxed" within a url hierarchy (so adding example.com/foo/ would add all linked pages that are also under example.com/foo/) or not (so it would also include linked pages to other domains or subfolders)?