3 ms·
None of them are very good in practice. Databases exist for just this sort of job.
by liveoneggs 3y ago
None of them are very good in practice. Databases exist for just this sort of job.
- webstrand 3y agoBut you're not supposed to store "large" blobs in databases, either?
- pizzafeelsright 3y agoDefine "large" because it keeps getting bigger. Systems I've built generally use a pointer within a database to a secondary location. I've also seen hundreds of megs stored in binary json blobs.
- snuxoll 3y agoFor what it's worth, I've built an entire data ingest pipeline with PostgreSQL that stores tens of millions of PDFs in a giant database table and...it works fine. Now we are working on scooping up a bunch of small (1-2KB) files we want to index with metadata and chucking them into a SQLite file, because as fast as `grep` is searching through the text the constant open() and close() calls are much more impactful.