3 ms·
I'd be interested to see how well this scales with a multi megabyte CSV.
by dan1234 13y ago
I'd be interested to see how well this scales with a multi megabyte CSV.
- scorredoira 13y agoIt seems that it loads the CSV into sqlite and the queries it. Inside a transaction I remember sqlite inserts about 60.000 records/sec.
- 72deluxe 13y agoIs that 60 (int) or 60 (float), or is that 60000?
- fletchowns 13y agoEven if you aren't familiar with the thousands separator, I don't think there's any ambiguity here.
- torrance 13y agoFrom what I can tell, this creates an SQLite instance each time it's executed, and creates it in memory unless told not to do so. So I'd guess it wouldn't scale well. Still really neat though!
- slashcom 13y agoEven then, it should scale reasonable well if one added a repl, and kept the database in memory. Probably would be fine then up until at least a couple gigabytes, depending on how well sqlite handles in-memory tables (probably very well).