3 ms·
14 million? Okay, that's not very much. A RAM-based approach is fine there.
by dfranke 19y ago
14 million? Okay, that's not very much. A RAM-based approach is fine there.
- abstractbill 19y agoHeh, fair enough. Do many startups really have more than a few tens of millions of records to search though?
- dfranke 19y agoI can't speak statistically, but the one I work for now does and the one I'm about to start will too (but in the latter case I'm writing a DBMS, so that's kind of a pathological example). If all your content is human-generated and O(n) in size, then 10^7 is a lot. The big numbers come when your data is produced by a simulation, or when you're doing OLAPey things with O(n^2)-sized intermediate results. Real-life example: keeping a log of all users, the IPs they've logged in from, and when, and looking for evidence of sockpuppet accounts.
- nostrademons 19y agoDaily quote data for the stock exchanges is about 50 GB now. If you do any sort of intraday analysis, you're looking at terabytes of data...