4 ms·

Interesting effort :-) Unfortunately, your comparison table there is somewhere between misleading and insulting. Almost all of the "unique" features listed the

by Radim 9y ago

Interesting effort :-) Unfortunately, your comparison table there is somewhere between misleading and insulting. Almost all of the "unique" features listed there are in fact a standard part of Gensim. Fast approximative queries (using Annoy), memory mapping with lazy loading, ngrams features, format convertors, Python interface, parallelization, pre-trained models for download… There is a way to promote cool new libraries, but this ain't it.

patelajay285 9y ago
Hey Radim, Shoot me an e-mail (link in HN profile), we just created this a few days ago, so it hasn't been up long, and happy to fix any disagreements in the benchmarks. You're absolutely right about Annoy Indexing, but to be fair, I don't think it was part of Gensim when I started using it :). Gensim's a great library and Magnitude's not meant to be an attack on it (in fact we use it for our own converter) and we provide zero-training which Gensim does handle.
- Radim 9y ago
  I appreciate the offer, but I'm positive you can spot the issues yourself. Gensim has many warts for sure, but a benchmark that gives a green tick to itself in "Simple Pythonic interface" and a red check mark to Gensim, while copying the Gensim interface almost verbatim, was not created in good faith.
- patelajay285 9y ago
  I'll remove the comparison to Gensim :). It really wasn't meant to be an attack on Gensim. I think it's a good and versatile library that handles a lot, but the aim of Magnitude was to be what Keras is to TensorFlow, a simpler interface. For the record, the claim was "Pythonic interface" not "Python" interface because we support some Pythonic syntactic sugar like "cat in vectors" with the "__contains__" method and "for key, vector in vectors" with the "__iter__" method. It wasn't meant to be in bad faith, but I could see how that claim could be misinterpreted, so I will remove it. The interface is very similar to Gensim's, but Gensim is after all open source, and we made it very similar on purpose so it could be easily swapped out in our own internal codebase :). Like I said, I think Gensim's a great library! Thanks making us aware of your concerns, I also sent you an e-mail. I'll update the repository later today to remove the comparison.

by Radim 9y ago

patelajay285 9y ago

Hey Radim, Shoot me an e-mail (link in HN profile), we just created this a few days ago, so it hasn't been up long, and happy to fix any disagreements in the benchmarks. You're absolutely right about Annoy Indexing, but to be fair, I don't think it was part of Gensim when I started using it :). Gensim's a great library and Magnitude's not meant to be an attack on it (in fact we use it for our own converter) and we provide zero-training which Gensim does handle.

Radim 9y ago
I appreciate the offer, but I'm positive you can spot the issues yourself. Gensim has many warts for sure, but a benchmark that gives a green tick to itself in "Simple Pythonic interface" and a red check mark to Gensim, while copying the Gensim interface almost verbatim, was not created in good faith.
patelajay285 9y ago
I'll remove the comparison to Gensim :). It really wasn't meant to be an attack on Gensim. I think it's a good and versatile library that handles a lot, but the aim of Magnitude was to be what Keras is to TensorFlow, a simpler interface. For the record, the claim was "Pythonic interface" not "Python" interface because we support some Pythonic syntactic sugar like "cat in vectors" with the "__contains__" method and "for key, vector in vectors" with the "__iter__" method. It wasn't meant to be in bad faith, but I could see how that claim could be misinterpreted, so I will remove it. The interface is very similar to Gensim's, but Gensim is after all open source, and we made it very similar on purpose so it could be easily swapped out in our own internal codebase :). Like I said, I think Gensim's a great library! Thanks making us aware of your concerns, I also sent you an e-mail. I'll update the repository later today to remove the comparison.