10 ms·
SQLite does too much copying. I might have large binary assets and copying back and forth sounds terrible.
by adamnemecek 5y ago
SQLite does too much copying. I might have large binary assets and copying back and forth sounds terrible.
- pwg 5y agoAnd how is your custom format going to avoid copying? If you use the standard open()/[read()|write()]/close() then every read() or write() is a copy operation. Either copying from memory out to storage, or copying from storage into memory. If you instead mmap() the data then the copying is just hidden behind the VM page swapping routines in the kernel. But ultimately there will be a copy from storage into memory or a copy from memory into storage. And, have you bench-marked using Sqlite (in the simple form presented in the web page linked to above) to know whether the copying is an issue? If you have not bench-marked it, then you are just going on assumptions, and assumptions often have a very high probability of being wrong.