3 ms·
Bandwidth is pretty cheap. You could fetch the most common million host names every 24h. For longer tail stuff, you could use buckets. Cluster domains so only
by im3w1l 6y ago
Bandwidth is pretty cheap. You could fetch the most common million host names every 24h.
For longer tail stuff, you could use buckets. Cluster domains so only a few or ideally a single buckets need to be fetched. But make sure every bucket has multiple clusters.
"Give me the recipes and porn bucket please"
- TekMol 6y agoIf you have a trusted source for a million host names, you have a trusted source for one hostname. So why would you have to download a million upfront and not just the one you need?
- samoa42 6y agoit's not about trust but "hiding in a group of queries"
- salawat 6y agoBecause there's a big difference between asking for the address of a Mall vs. Asking for the address of the sex toy shop in the mall openly. Or the gun store. Or the space the labor Union rented out in the building for a meeting. Given that the Internet wasn't made with the concept of nosy people as a adversary or threat, many adversaries have flocked to using the metadata as a gold mine instead of just ignoring it and passing it along. Which is half the reason it seems like we can't just have nice things.