4 ms·
I built something like this as well! I wonder how you solved the data storage and indexing. Does it scale to multi-month heavy usage ? Does it deduplicate mult
by ysleepy 10y ago
I built something like this as well!
I wonder how you solved the data storage and indexing. Does it scale to multi-month heavy usage ? Does it deduplicate multiple visits?
Cool stuff, gotta put mine somewhere. Always planned to, but never got around to it.
- unclesaamm 10y agoLooking in the code, it loops over all the indexed text and does substring matching on tokens from the search query. Good enough for everyone so far, but...
- alistproducer2 10y agoI wrote an extension that did this as well. I used indexedDb. Before I implemented encryption on the DB, it scaled well. I had an algorithm that got the size of the largest pages down to ~2-3kb and I only stored diffs on subsequent visits to the same pages. After encryption, things got unruly because the text had to be stored in fixed length chunks.