3 ms·

Seems odd to publish a benchmark against Lucene where your results are "Lucene crashes at 4 concurrent users". Since there are thousands of people using Lucene

Seems odd to publish a benchmark against Lucene where your results are "Lucene crashes at 4 concurrent users". Since there are thousands of people using Lucene and products built on Lucene every day, I think the issue may be in your benchmarking code.

wolfgarbe 5y ago
There is no secret about the benchmark, its all open source: https://github.com/wolfgarbe/LuceneBench https://github.com/wolfgarbe/LuceneBench
- arafalov 5y ago
  It seems you tried MMapDirectory and then commented it out. https://github.com/wolfgarbe/LuceneBench/blob/master/LuceneBench/src/LuceneCore.java#L52-L53 https://github.com/wolfgarbe/LuceneBench/blob/master/LuceneB... So, you may be hitting SimpleFSDirectory instead, which does have issues with too many searches. Could you share the reasons, MMapDirectory did not work for you?
  - wolfgarbe 5y ago
    "NIOFSDirectory and MMapDirectory implementations face file-channel issues in Windows and memory release problems respectively. To overcome such environment peculiarities Lucene provides the FSDirectory.open() method. When invoked, it tries to choose the best implementation depending on the environment." https://www.baeldung.com/lucene-file-search https://www.baeldung.com/lucene-file-search
    - arafalov 5y ago
      Right. I found you are running on Windows after posting the comment. Makes sense, though there were some fixes in the latest Lucene I believe. The Lucene's own benchmarks are at: https://home.apache.org/~mikemccand/lucenebench/ https://home.apache.org/~mikemccand/lucenebench/ , though I admit to not know enough about benchmarking to form a strong opinion. Either way, good luck with the project/service. More competition is always great. The open-source components look interesting too.
Semaphor 5y ago
The way I understand it is that it crashes when 4 concurrent users are running the benchmark. Which could make sense if it’s a stress-test.

wolfgarbe 5y ago

There is no secret about the benchmark, its all open source: https://github.com/wolfgarbe/LuceneBench https://github.com/wolfgarbe/LuceneBench

arafalov 5y ago
It seems you tried MMapDirectory and then commented it out. https://github.com/wolfgarbe/LuceneBench/blob/master/LuceneBench/src/LuceneCore.java#L52-L53 https://github.com/wolfgarbe/LuceneBench/blob/master/LuceneB... So, you may be hitting SimpleFSDirectory instead, which does have issues with too many searches. Could you share the reasons, MMapDirectory did not work for you?
- wolfgarbe 5y ago
  "NIOFSDirectory and MMapDirectory implementations face file-channel issues in Windows and memory release problems respectively. To overcome such environment peculiarities Lucene provides the FSDirectory.open() method. When invoked, it tries to choose the best implementation depending on the environment." https://www.baeldung.com/lucene-file-search https://www.baeldung.com/lucene-file-search
  - arafalov 5y ago
    Right. I found you are running on Windows after posting the comment. Makes sense, though there were some fixes in the latest Lucene I believe. The Lucene's own benchmarks are at: https://home.apache.org/~mikemccand/lucenebench/ https://home.apache.org/~mikemccand/lucenebench/ , though I admit to not know enough about benchmarking to form a strong opinion. Either way, good luck with the project/service. More competition is always great. The open-source components look interesting too.

Semaphor 5y ago

The way I understand it is that it crashes when 4 concurrent users are running the benchmark. Which could make sense if it’s a stress-test.