3 ms·
Storing web logs in a SQL database is a pretty bad plan.
by jeffbee 6y ago
Storing web logs in a SQL database is a pretty bad plan.
- posix_me_less 6y agoYeah, this poke my eye as well.
- tyingq 6y agoCombined with "The database was initially designed to have a single table for each day." Oy.
- cm2187 6y agoYeah, if they do that they might as well shard databases and not have this problem in the first place (not that there aren’t better tools)
- isatty 6y agoAt this scale and amount of data, definitely. I have however dumped short term data into an unlogged temp Postgres table to query data using Metabase/psql. Worked surprisingly well enough for me to debug something. I'm sure another index on ES would've worked well too, but I'm more familiar with SQL than ES syntax and it's cheaper too.