I forget the web page - I think from another HN reader - but they made the point that these challenges are the exact challenges that distributed computing wrest

I forget the web page - I think from another HN reader - but they made the point that these challenges are the exact challenges that distributed computing wrestles with. For any problem set that a lot of resources are working with, how do you properly surface the most valuable results, how do you combine and summarize them, etc. There are a lot of discussion community sites that just try to pull in their own homegrown algorithms ("let's have a moderator!") but I suspect a lot of these experiences could be improved by reading up on distributed computing algorithms.