huahaiy

18 ms·

61.
by huahaiy 4y ago
What are the "missing or rotting libraries"? Maybe a few examples might be helpful. In my over 10 years of using Clojure in production, I am not sure I have "re-implemented" a lot of logic that are not already covered b
62.
by huahaiy 4y ago
Sounds like Datalevin https://github.com/juji-io/datalevin Embeddable, check. Datomic data model and Datalog query, check. Storage written in C, check.
63.
by huahaiy 4y ago
Not exactly. My goal of developing Datalevin is to replace our use of both Datomic and Postgres, so we have a single DB. The aim is to provide a versatile database that meets data needs of most use cases. I mention Sqlite in README because
64.
by huahaiy 4y ago
Every database that implements MVCC does this, that means most ACID databases. So "reading a consistent view" is not unique for Datomic.
65.
by huahaiy 5y ago
The "hostility" I referred to was the one towards the users. Basically, he's demanding users to show evidence that whatever they want is better than BM25. That's just wrong. Period. This is the reason I mention his job,
66.
by huahaiy 5y ago
One observation I have to make: this community of information retrieval seems to be very thin-faced and cannot seem to accept outside contributions. I hope I am wrong. This is not an isolated case. They rejected some industry changing cont
67.
by huahaiy 5y ago
Again, you miss the novelty of the algorithm due to your smugness. I have updated the article to point out explicitly where the novelty is at. You completely ignored that. In fact, I believe you didn't even read that far before your ju
68.
by huahaiy 5y ago
BTW, you were with me? Where? Why do you have to use a throwaway account to say this, I am curious.
69.
by huahaiy 5y ago
For what its worth, a final advise for those fresh graduates and college students. Don't take too seriously what your learned from books in school. They are not the gold standard the society measures things by. You got the wrong impres
70.
by huahaiy 5y ago
Thank you. I am glad that you learned something from the article. I wrote the article for people like you, who are seeking knowledge and self improvement.
71.
by huahaiy 5y ago
Did I claim that? Straw man much?
72.
by huahaiy 5y ago
Not my nickname, my name. It's good for you that you are not a racist (it's sad that such a normal thing has to be a compliment, but it is a compliment. Good for you.), but racists do look for these cues and make their judgement b
73.
by huahaiy 5y ago
That's the problem right there. The so called "Information Retrieval Community" does not seem to care about what users want, and they treat their users in a condescending way, ignoring an obvious problem for years, as clearly
74.
by huahaiy 5y ago
As I have repeated suggested, since you obviously know Lucene, it does not take much for you to write a few lines of Java code to say, "here, this is how it is supposed to be done". Instead, you keeps giving all kind of excuses. Y
75.
by huahaiy 5y ago
Let me offer my arguably biased insight: racism. I am obviously a Chinese. In the eyes of racists, Chinese Americans are supposed to be timid and does not make any noises, but I do make noises, so I am perceived as a smug today because I sa
76.
by huahaiy 5y ago
You are making up straw man again. Did I make that claim? I was simply motivate my work, pointing out it's a problem that the current generation of search engine does not address. What is "relevance", it is of course a contex
77.
by huahaiy 5y ago
You either has or has no guarantee, that's what the word "guarantee" means. Don't mince words. You had a wrong understanding. Now you are corrected. Let's move on. Nobody said anything about "fewer term matches
78.
by huahaiy 5y ago
I think I am pretty qualified to make my declaration, since it is about user experience. I also do know a lot about IR, because I taught Information Retrieval class for 3 years when I was teaching in university, I read research papers, and
79.
by huahaiy 5y ago
There's no guarantee in pure vector space model that it is the case. Your understanding is way off. This is a caveat that Lucene prominently put on their Web page. https://lucene.apache.org/core/3_5_0/scoring.
80.
by huahaiy 5y ago
I do not want to tweak Lucene. I don't want a huge dependency. I don't want Lucene. Period. I am writing a database, full-text search is just a *minor* feature. Why should I bringing in a huge dependency for a minor feature when m
81.
by huahaiy 5y ago
Feeling smug? You fundamentally misunderstand both Wand and T-Wand. I suggest you to read my article and the papers again. The novelty of T-Wand, is not in sorting the rows on idf, which T-Wand actually does NOT do, but in adding some filte
82.
by huahaiy 5y ago
I don't think he misunderstood anything. There's the kind of library Lucene wants to be, a configurable library. But there are other libraries do not want that. In this case, Datalevin is a database system, full-text search is jus
83.
by huahaiy 5y ago
It's your loss then. It is actually smug, to suggest the author, in this case, me, a computer scientist and a past professor who taught Information Retrieval class for more than 3 years, and who just came up with a new search algorithm
84.
by huahaiy 5y ago
It would really be a sad joke if one dismisses a good technology just because he does not like the tone of the author of the said technology. Besides, the said technology does do tf-idf and fuzzy search, and will soon have phrase search, an
85.
by huahaiy 5y ago
Incorrect. The benchmark is fine. Your so-called "fundamental" flaws are just superficial things, such as using a different time measure, using a different benchmark library, passing in a thread pool, and so on. These are immateri
86.
by huahaiy 5y ago
It does have relevance to user experience, which is under discussion.
87.
by huahaiy 5y ago
BM25 is just a variant of tf-idf.
88.
by huahaiy 5y ago
Corrected. Thanks. I am not a native English speaker, so please do not read too much into it.
89.
by huahaiy 5y ago
Show me how to do that? I will integrate that into the benchmark. Thanks.
90.
by huahaiy 5y ago
Merged your PR. Thank you! If you do not know Clojure, that's fine, just outline what you want to do in Java, I can translate that into Clojure. Thanks. To be honest, all your proposed changes would not make material difference, for al

More ›