> for all user uploaded files use external storage like NFS or S3 We send our log files to S3 too. I mean, we write them locally (EC2) and then push them to S3

> for all user uploaded files use external storage like NFS or S3 We send our log files to S3 too. I mean, we write them locally (EC2) and then push them to S3 every minute. Then we have a tool that will let us search the log files in S3 and it will parse these rotated log files and join together the relevant pieces depending on what we're looking for (or all of it for a specific time period if we don't know what we're looking for). This is great because if the server goes down and we can't access it, or the instance is gone, we can still see log files from shortly before the problem occured. We also use bugsnag, etc for real time logging and tracking where possible.