4 ms·

So uh ... 100 petabytes, then. Ah.

• marginalia_nu 5y ago
  Realistically you could probably get away with something like a couple of terabytes, and then default to the regular index if it isn't found in the neighborhood close to your favored sites, but that's still anything but cheap especially this can't be some slow-ass S3 storage, this storage should ideally be SSDs or a RAID/JBOD-configuration of mechanical drives. That means you're also paying for a lot of I/O bandwidth and overall data logistics. If you try to rent that sort of compute, you're probably looking at like $100-200/month.