3 ms·
Implementing your own index gives you more control over it. I think at this scale you probably want to tweak things specifically to your product rather than usi
by ZephyrBlu 4y ago
Implementing your own index gives you more control over it. I think at this scale you probably want to tweak things specifically to your product rather than using a generic solution. I would guess that what you're indexing on (E.g. language, file, repo, etc) and sharding strategy affects the structure of your index as well.
- boyter 4y agoBelieve me I am aware. I am one of those who implemented their own index for a code search engine :) I did it for my own learning, but find it interesting because something like elastic with trigrams can get you very close, albeit at a far greater cost.
- ZephyrBlu 4y agoI'm reading your blog posts about building your own index now. I started writing my own very simple index and search engine, but quickly decided to just use ClickHouse via https://tinybird.co https://tinybird.co as my backend (Serverless SQL with automatic APIs is pretty sweet) because I wanted to build out the product side of things and my data is really small, so I felt like it was going to be a lot of effort for little reward. Maybe one day I will need to write a custom index or search engine that actually scales though :).
- boyter 4y agoI won’t hijack this thread with details but if you have questions you can find my details on my profile.