3 ms·
Whoosh is great in that it fits the django philosophy of building sites fast, but I wouldn't use if for anything harder than a small site search. Once my site g
by piqufoh 13y ago
Whoosh is great in that it fits the django philosophy of building sites fast, but I wouldn't use if for anything harder than a small site search. Once my site grew larger than 50 mb of text queries started slowing things down. Indexing (python, single threaded) took a while and the larger the index the slower the queries were returned.
It's probably the best first iteration search app that I've come across, and you can always slip in solr or something with more umph when you need it.
- WoodenChair 13y agoCan you clarify why you would not use it on anything harder than a small site search? Without context, the comment is not especially helpful.
- mattdeboard 13y ago> Once my site grew larger than 50 mb of text queries started slowing things down. Indexing (python, single threaded) took a while and the larger the index the slower the queries were returned. I think this makes it pretty clear. Not sure how much more explanation you need.
- WoodenChair 13y agoWasn't in the original comment... yet another example of why HN should not have edit.
- ra 13y agoFor very small datasets, Whoosh is fine. For anything larger than 'site search' on a website that has no UGC, you're much better off with SOLR (or ES, Xapian or Sphinx - whatever your poison). When document counts get into the hundreds you see orders of magnitude faster queries with SOLR (etc), not to mention much more sophisticated querying options.
- hackerboos 13y agoElasticSearch with Haystack is the next logical move after outgrowing Whoosh.
- andrewingram 13y agoBased on my own experiences, by the time search is an important enough feature to outgrow Whoosh, you've also outgrown Haystack's API.
- nknighthb 13y ago> Indexing (python, single threaded) took a while The documentation indicates there is a multiprocessing option. (Also configurable memory limits, if you didn't see that.) http://whoosh.readthedocs.org/en/latest/batch.html http://whoosh.readthedocs.org/en/latest/batch.html
- piqufoh 13y agoOoh - handy, I hadn't seen that thanks. I'll try it out.