ive thought about this too when considering an architecture like the one described ..seems as though storing in S3 is a good first stop for the data as it takes

ive thought about this too when considering an architecture like the one described ..seems as though storing in S3 is a good first stop for the data as it takes very little care and feeding for a massive amount of data. then, depending on your query and data processing needs you can look to other tools such as elastic search, or elastic map reduce or xyz db. see also : http://petewarden.com/2010/10/01/how-i-ended-up-using-s3-as-my-database/ http://petewarden.com/2010/10/01/how-i-ended-up-using-s3-as-...