whakim

7 ms·

61.
by whakim 2y ago
Could you talk about how updates are handled? My understanding is that IVF can struggle if you're doing a lot of inserts/updates after index creation, as the data needs to be incrementally re-clustered (or the entire index needs t
62.
by whakim 2y ago
I don't see how this won't eventually converge towards some kind of AI-optimized SEO; presumably there's some algorithm which surfaces sponsored follow-up questions for a given query?
63.
by whakim 2y ago
It isn't really possible to link taxation to spending in this way, because there are things that cost a lot of money (say, healthcare for poor folks) which are in the public interest but no direct tax to pay for them; meanwhile there a
64.
by whakim 2y ago
Hey there! Will, author here. Thanks for the question! On batch processing: one thing we've found is that customers often use tools such as Halcyon's to do research or build models; they basically want a matrix of questions (each
65.
by whakim 2y ago
Hey! Will, author here. I appreciate your feedback and we've increased the line-height. Hopefully that's a little more readable. We'll also look into the sibling comment on Lockdown Mode and see if there's a way we can f
66.
What I've learned building with AI(halcyon.eco)
50 points by whakim 2y ago|10 comments
67.
by whakim 2y ago
Yeah, logical replication is supported on PostgreSQL today and would support adding indices to a replica. I am not sure if that works in this case, though, because what's described here isn't just an index.
68.
by whakim 2y ago
Thanks for your answer. I hear you on using a read-replica to serve embedding-based queries, but I worry there are lots of cases where that breaks down in practice: presumably you still need to do a bunch of IO on the primary to support ins
69.
by whakim 2y ago
This is actually really cool, and despite what I'm sure will come off as (constructive) criticism, I am very impressed! First, I think you oversell the overhead of keeping data in sync and the costs of not doing so in a timely manner.
70.
by whakim 2y ago
It wasn’t clear to me that this sort of thing is explicitly forbidden under this regulation?
71.
by whakim 2y ago
The author offers no evidence for the claim that API management and security solutions are needlessly complex in order to create more business for themselves. I think it's much more likely that API management and security software has
72.
by whakim 2y ago
I work at a startup that is less than 1 year old and we have indices that are in the hundreds of gigabytes. It is not as uncommon as you think. Scaling vertically is extremely expensive, especially if one doesn’t take your (misguided) sugge
73.
by whakim 2y ago
Yes, scaling vertically is much easier than scaling horizontally and dealing with replicas, caching, etc. But that certainly has limits and shouldn’t be taken as gospel, and is also way more expensive when you’re starting to deal with ter
74.
by whakim 2y ago
But they can still do that even if there's a cost calculator upfront. Removing the calculator simply obfuscates the ability to estimate cost with the happy justification that fault lies with the customers who all seem to be bad at es
75.
by whakim 2y ago
I don’t get it. Presumably the pricing model didn’t change, so all you’ve done is push the burden of doing the math onto the user (or more realistically, hope they just don’t even bother?) If users are frequently estimating costs that are o
76.
by whakim 2y ago
I think neo4j is a perfectly good starting point. Yeah, I feel like they definitely push their enterprise offering pretty hard, but having a fully managed offering is totally worth it IMO.
77.
by whakim 2y ago
While I'm all for standards-based options, I think the fetishization does a disservice to anyone dipping their toes into graph databases for the first time. For someone with no prior experience, Cypher is everywhere and implements a to
78.
by whakim 2y ago
We just skip several of unstructured's categories, such as tables and images. We also do some deduplication post-ANN as we want to optimize for novelty as well as relevance. That being said, how are you planning to embed an image or a
79.
by whakim 2y ago
We have been using different things for text, images, and tables. I think it's worth pointing out that PDFs are extremely messy under-the-hood so expecting perfect output is a fool's errand; transformers are extremely powerful and
80.
by whakim 2y ago
You could make the exact same argument about locks (which are trivially defeated) - add up all the time that people spend unlocking doors and I'm sure you'd end up with a huge amount of time; add up all the money that people spe
81.
R > g; Specialization in the age of AI(halcyon.eco)
6 points by whakim 2y ago|0 comments
82.
by whakim 2y ago
Escape Collective did an article on this ( https://escapecollective.com/what-would-happen-if-everyone-i... ), and while at first glance there's a lot to like about a "spec series" for cycling, ultimately it wou
83.
by whakim 2y ago
> And similar proposals like the Negative Income Tax would cost far less money and have none of the presented downsides. It all depends on how you tweak the numbers; in theory a negative income tax and a guaranteed income cost exactly th
84.
by whakim 2y ago
Contrary to some of the sibling responses, my experience with pgvector specifically (with hundreds of millions or billions of vectors) is that the workload is quite different from your typical web-app workload, enough so that you really wan
85.
by whakim 2y ago
I’d start with something very simple such as Reciprocal Rank Fusion. I’d also want to make sure I really trusted the outputs of each search pipeline before worrying too much about the appropriate algorithm for combining the rankings.
86.
by whakim 2y ago
I agree that there's a focus on algorithmic improvements, but what is the basis for assuming that we'll be able to continue to make algorithmic improvements on the same scale? The argument feels exactly backwards - if you had a de
87.
Problems, Productivity, and Progress(halcyon.eco)
7 points by whakim 2y ago|0 comments
88.
by whakim 2y ago
I’m very skeptical of any future prediction whose main evidence is an extrapolation of existing trendlines. Moore’s Law - frequently referenced in the original article - provides a cautionary tale for such thinking. Plenty of folks in the 9
89.
by whakim 2y ago
Absolutely. But we’ve been past the “golden age” of polling using live callers on landlines for more than 20 years now. We now have a reasonable corpus of polling data that we can use to evaluate how good pollsters are at making the correct
90.
Timing Is Everything(halcyon.eco)
3 points by whakim 2y ago|0 comments

More ›