4 ms·
And if you want a hassle free scalable search service with automatic sharding/scaling, a lucene underpinning and a nice REST API: Elasticsearch
by rb2k_ 15y ago
And if you want a hassle free scalable search service with automatic sharding/scaling, a lucene underpinning and a nice REST API:
Elasticsearch
- deleted 15y ago[deleted]
- espeed 15y agoIndexTank is now open source and the code is here (http://engineering.linkedin.com/open-source/indextank-now-open-source http://engineering.linkedin.com/open-source/indextank-now-op...).
- Mikushi 15y agoAnd if you want an actually good search product there is always SphinxSearch.
- avar 15y agoWhy wouldn't you consider ElasticSearch to be an "actually good search product" ?
- cmiles74 15y agoWhy the bashing on Elasticsearch? We are using it to index log files; we have over 275 million documents in our index and performance has been pretty impressive.
- deleted 15y ago[deleted]
- PanMan 15y agoWhat kind of hardware are you running that on? We are setting up a larger cluster, and are interested in the config of others. Thnx!
- cmiles74 15y agoWe're running on five EC2 instances, each instance is running Elasticsearch configured to use 25GB of RAM. With the current data set we might be able to get by with less RAM, we're still in the process of figuring out what works best for us.
- lobster_johnson 15y agoLast I checked, Sphinx had a huge design flaw in that it indexed directly from an SQL database. In other words, your Sphinx configuration not only needs to have read access to the database, it needs to contain the required SQL queries. This tightly couples Sphinx to your application and your schema, and creates serious issues for your ops team since every app change potentially needs to modify the Sphinx config. It gets particularly hairy when you want to host multiple applications using a single Sphinx daemon. We started out with Sphinx for our apps but quickly discarded it in favour of ElasticSearch, a much more elegant and orthogonal piece of software.
- shingen 15y agoThat's incorrect. Sphinx can index documents and does not require an SQL database. Such has been the case for a few years now.
- deleted 15y ago[deleted]
- paulsmith 15y agoThat's not true, you can pipe in data from any source: http://sphinxsearch.com/docs/2.0.4/xmlpipe2.html http://sphinxsearch.com/docs/2.0.4/xmlpipe2.html
- barrybhunter 15y agoAlso sphinx as real-time indexes. You send data to sphinx (when you update it), and its indexed right away. The original disk-indexes (updated by a batch process is still available)
- JohnGolt 15y agoThat's why you could look at IndexDen.com which powered by Sphinx Search cluster :)
- jshen 15y agoI always find sphinx limiting. For example, I can add a single doc to the index, I have to run a full re-index. Also, I can't programmatically get a list of all "words" in the index with their frequency and the inverse dod freq, etc. With anything lucene based this kind of thing is really easy.
- tylerlh 15y ago+1 on this. I really liked Sphinx until I started inserting records...
- joshhart 15y agohttp://senseidb.com/ http://senseidb.com/ is another alternative that I work on used for search at LinkedIn. It's API compatible with Elasticsearch.