Cloudflare launched a product to do that last year: https://blog.cloudflare.com/introducing-pay-per-crawl/ https://blog.cloudflare.com/introducing-pay-per-crawl

Cloudflare launched a product to do that last year: https://blog.cloudflare.com/introducing-pay-per-crawl/ https://blog.cloudflare.com/introducing-pay-per-crawl/ I have no idea if it actually works as advertised though. I don't think I've heard from anyone trying it.