3 ms·
> The hardest part of building any search engine is keeping the index up-to-date with changes made to the underlying data store. That makes sense and I'm curio
by almog 4y ago
> The hardest part of building any search engine is keeping the index up-to-date with changes made to the underlying data store.
That makes sense and I'm curious to know if you're referring to the challenges that arise from attempting to implement a distributed heterogeneous transaction that includes system of record (say RDBMS) and derived data (search engine), or did you think about something that's more specific to search engines?
- simonw 4y agoJust the general challenge of making sure that updates to your database are reflected in your index promptly. I gave a talk about this a few years ago: https://speakerdeck.com/simon/the-denormalized-query-engine-design-pattern https://speakerdeck.com/simon/the-denormalized-query-engine-... / https://www.youtube.com/watch?v=NzcvewgqYog https://www.youtube.com/watch?v=NzcvewgqYog