4 ms·
Let’s say I have 10TB of data that I want to make searchable, and want to self host, what are my options with Meilisearch?
by dutchbrit 4y ago
Let’s say I have 10TB of data that I want to make searchable, and want to self host, what are my options with Meilisearch?
- ferdi05 4y agoThere is "Run in production" guide in Meilisearch documentation https://docs.meilisearch.com/learn/cookbooks/running_production.html https://docs.meilisearch.com/learn/cookbooks/running_product... It uses DigitalOcean, but self-hosting in the right environment should work in a close way.
- dutchbrit 4y agoThanks for the link! I however still don’t know how I’d be able to scale meilisearch to index terabytes of data.
- qdequelen 4y agoCan I get your use case? What is the data you have to index? If it's logs, indeed, Meilisearch will not be the best fit. I would recommend https://quickwit.io https://quickwit.io. If it's structured or unstructured data, even if 10TB seems huge for our use cases, I would love to put you in contact with my engineering team. We would find a way to manage it.
- francoismassot 4y agoI'm curious also about your use case (disclaimer, I'm one of the cofounder of Quickwit). Do you want simple search with a basic UI? Or some dashboarding with grafana for example? Thanks @qdequelen for pointing out Quickwit :)