3 ms·
So ahrefs is a special case because they're literally crawling the internet and scrapping Google. Their entire service is based on having a lot of servers. It
by senttoschool 4y ago
So ahrefs is a special case because they're literally crawling the internet and scrapping Google.
Their entire service is based on having a lot of servers.
It's not the same as your typical Silicon Valley CRUD app.
- manquer 4y agoDo you really need that much infra to index 10 million sites ? Many other indexing tools are not this well funded and are able to be effective?