moab

10 ms·

61.
by moab 3y ago
https://ai.googleblog.com/2022/05/language-models-perform-re... You can google for more results / papers.
62.
by moab 3y ago
Not sure why you're being downvoted. IIUC, pgvector uses a clustering implementation similar to ones implemented by FAISS. These are pretty simple / straightforward to implement but do not give the best performance. For more on th
63.
by moab 3y ago
Work stealing makes it arguably much easier to program than CUDA or OpenCL.
64.
by moab 3y ago
> I’d still take HNSW over such approach Why? Sorry, but your comment is not very insightful without more explanation, and the rest of your comment is just an advertisement for your (admittedly impressive looking) work.
65.
by moab 3y ago
Spot on. There is zero moat and the self-hosted alternatives are rapidly improving (if not better) than Pinecone. There are good open-source contributions coming from bigcorp beyond Meta too, e.g., DiskANN ( https://github.com&#x2
66.
by moab 3y ago
That's very fair. I'm sorry for being rude and have a great weekend as well.
67.
by moab 3y ago
You don't know what you're talking about. Research and teaching at the upper-division level can and should be two sides of the same coin.
68.
by moab 3y ago
That's not even remotely true (re: the need to use LinkedIn). Just quit.
69.
by moab 4y ago
Do you plan to publish about what is being implemented soon / support ANN Benchmarks or BigANN Benchmarks?
70.
by moab 4y ago
I am not sure what algorithmic "secret sauce" pinecone is implementing beyond being a wrapper around FAISS, but I have got to give it to James that he is doing god's work in helping people understand ANNS and how to apply it.
71.
by moab 4y ago
> including software highly unlikely. You should be concerned if you are just plumbing between different software stacks, but even that is likely hard to fully automate.
72.
by moab 4y ago
Makes sense. I hope you keep working on this. There is a big gap between what people are doing in the academic (and even publicly-described industrial literature) and what you describe. So I think there is a lot of opportunity to push on th
73.
by moab 4y ago
Totally agree with your last point. But based on my understanding, over the past 5-ish years commodity multicores with multi-terabyte memories have made a big dent in the supremacy of supercomputing, at least for some of the topics you ment
74.
by moab 4y ago
> codes that would be effectively computationally intractable if you tried to run them in, say, AWS. such as?
75.
by moab 4y ago
I mean, that's what I'm wondering about his parents. They must have known, or at least had a feeling. And not looking into that and giving your child some advice not to go down this path, or to be careful, and at the very least, n
76.
by moab 4y ago
I'm pretty sure you are. I've never seen M being used for thousand.
77.
by moab 4y ago
How can you feel sorry for them? They're professors of LAW at Stanford. And this white-collar crime was being committed right under their noses. Pynchon would have had trouble coming up with a plot this wacky.
78.
by moab 4y ago
110 years! I wonder how many she'll get out of that for being the first out of the woodwork.
79.
by moab 4y ago
If someone keeps shooting themselves in the foot, at some point you have to throw in the towel and call a moron a moron.
80.
by moab 4y ago
What a hypocrite. Elon is now living in an alternate reality where he is being constantly persecuted, defamed, and under attack. I wish him all the best, but based on our great works of literature (think Macbeth), it's usually all down
81.
by moab 4y ago
As a little twist on the author's badly thought out proposal, what if we simply take the NSF scheme for doling out funding and make it more broadly available. Each year (or every few years) you can submit a proposal about what you plan
82.
by moab 4y ago
It wasn’t just rich people. What about the patients that were lied to? The employees?
83.
by moab 4y ago
I think it's quite different. For GPUs these archiecture-specific optimizations / primitives make orders of magnitude difference (and also change from version to version). On the other hand, multicore code I wrote ~8 years ago in
84.
by moab 4y ago
That sounds awful and a big reason why I think GPUs will go the way of the dinosaur in the near future.
85.
by moab 4y ago
There are many "extra" features that one needs in practice which are patently not solved, starting with working in a dynamic setting.
86.
by moab 4y ago
Should faculty be paid more? Absolutely. Should Ph.D. students be paid more? Absolutely!! But the blanket statement you make in (1) is wrong and strikes me as awfully close to the extreme left-wing and right-wing mindsets of "the syste
87.
by moab 4y ago
In previous generations, other forms of popular culture filled the same role, and hordes of young kids conformed in exactly the same way. From the beats and hippies all the way to skate culture in the 00s. I'm sure my parents felt the
88.
by moab 4y ago
:-)
89.
by moab 4y ago
It's spelled "shibboleth". You could have googled it.
90.
by moab 4y ago
Plenty of those, and inter-racial Indian marriages among friends who happen to be upper-caste exist. You're either not a first-generation Indian (seems likely) or you're seeing the story you believe in. And FWIW, even my dad'

More ›