4 ms·
Forcing them to give anyone access to their index at a fair price wouldn't be unprecedented. In Europe that's a common method to deal with infrastructure: anyon
by wongarsu 7y ago
Forcing them to give anyone access to their index at a fair price wouldn't be unprecedented. In Europe that's a common method to deal with infrastructure: anyone can lay a phone line, but you have to sell access to competitors at a fair price.
Alternatively we could just publicly fund a crawler. A project like Common Crawl, just bigger and better, with some simple indexes prebuilt.