I assume the issue is building the backend to store all the data. I don't see why instrumenting a popular site is any different to instrumenting an unpopular si

I assume the issue is building the backend to store all the data. I don't see why instrumenting a popular site is any different to instrumenting an unpopular site. This is vastly different problem, which is mostly about distributed systems and algorithms. Alex Smola's Hokusai paper is good place to start for analytics on truly massive traffic: http://www.auai.org/uai2012/papers/231.pdf http://www.auai.org/uai2012/papers/231.pdf