3 ms·
Neat! Have you considered using query params instead of bodies, then just piping the access logs to a spool (no program actually on the server, just return an e
by withinboredom 4y ago
Neat! Have you considered using query params instead of bodies, then just piping the access logs to a spool (no program actually on the server, just return an empty file). Then your program can just read from the spool and dump them into sqlite.
That should tremendously improve throughput, at the expense of some latency.
- Nevin1901 4y agoThat's a really good idea, thanks for suggesting it. I'll try implementing it. I'm hoping the main bottleneck is with inserting the logs into SQLite, so using a spool might help