4 ms·
Any blog posts or talks that inspired this? How do you handle retention? Any libraries or tools that helped with it? I can see the use of such logging clearly,
by acidbaseextract 8y ago
Any blog posts or talks that inspired this? How do you handle retention? Any libraries or tools that helped with it?
I can see the use of such logging clearly, but I work at a young startup and implementing that ourselves sounds like infrastructure overkill. Maybe I'm overestimating the work?
Thanks for any thoughts!
- griffordson 8y agoSorry, just saw your reply. I suspect you are overestimating the work. I just added some Rack middleware to handle request logging. Then plugged into the Rails model callbacks to record the CRUD events into a different Kinesis stream. And we're a 3 dev shop and I did this on my own over a few weeks part-time. As far as retention goes, I just dump to it to S3 for permanent storage. Kinesis Firehose makes that dead simple. I also push each event into AWS hosted Elastic Search and I could theoretically purge older data, but for our volume of data, I'll likely retain it there for years. Edit: Also, I generate UUID in the Rack middleware and set a Thread Local Storage variable that I can pull out in the CRUD logging so that I can always see what Rack request caused the CRUD model event.
- acidbaseextract 8y agoSounds like I did way overestimate. Thank you for the structure!!