4 ms·
The usecase in the article was to parse logs from a CDN serving cached content not an app server which serves every request.
by gilfoyle 8y ago
The usecase in the article was to parse logs from a CDN serving cached content not an app server which serves every request.
- erulabs 8y agoRubygems.org uses Fastly which supports streaming logs (as should any CDN worth their salt - there is no reason whatsoever to wait a whole day to download data that is by definition event-based). FWIW, Fastly CDN log streaming is exactly how I built the view-count system I mentioned above. At the end of the day a computer does a thing and counts the thing it did. Why write down what it did in a bloated format that only needs to be picked apart later?
- zerd 8y agoFrom the post it looks like that's what he does now. Fastly uploads files to S3 (you can specify how often), and then a Lambda function is run per file to aggregate the files into view-counts. How is this different from yours?