spmurrayzzz

16 ms·

91.
by spmurrayzzz 2y ago
Chroma certainly doesn't have the most advanced API in this area, but you can for sure store chunks or documents, its up to you. If your document size is too large to generate embeddings in a single forward pass, then yes you do need t
92.
by spmurrayzzz 2y ago
This is also the case with weaviate (as you assumed). If you update the value of any previously vectorized property, weaviate generates new vectors automatically for you.
93.
by spmurrayzzz 2y ago
Yea I think I understand your motivation re: not donating your time. I guess my assumption was more-so that the likelihood of 3k SLOC UI project becoming a business seemed incredibly remote. Perhaps that is misguided.
94.
by spmurrayzzz 2y ago
Not the author, but given that this is a relatively small UI wrapper of a zoekt[1] backend, it seems like the risk here is isolated to the upstream Sourcegraph-maintained search dependency. By relatively small, I mean that the total SLOC fo
95.
by spmurrayzzz 2y ago
I've definitely noticed the same in my career. Its easy to get caught up in the day-to-day and forget some of the reasons you got started doing all this in the first place (in my case, because its fun and I'm passionate about soft
96.
by spmurrayzzz 2y ago
I appreciate the time you took to write this all out (both the article and your response here). In particular, this line from the article resonated with my own experience over the last couple of decades: > This particular setup—viewing D
97.
by spmurrayzzz 2y ago
Ah, interesting. That sort of split voting is indeed very bad luck, potentially a config-specific issue, or just a cluster that's seeing a catastrophic partition failure between every node. In canonical Raft assuming no partition failu
98.
by spmurrayzzz 2y ago
> Reminds me of this one time we had a Raft cluster arguing over who was the leader for 20 minutes in production That's certainly an interesting failure mode. Do you recall the details around root cause? I could imagine ephemeral ne
99.
by spmurrayzzz 2y ago
I tend to agree that many explanations of raft dont get into the useful details and handwave some of the hard problems. But the original paper does do a good job of this and is pretty accessible to read IMO. > I read "once the leade
100.
by spmurrayzzz 2y ago
I should have quoted you more specifically, my apologies. I was responding to the comment that there was some training of the "model on your chosen book". There is no fine-tuning done specific to the corpus you own. I noted this i
101.
by spmurrayzzz 2y ago
> they have some long-context "Memory Model" (whose details I've yet to fully understand) Section 2.2 of the paper[1] goes into this in more detail. They pretrain the draft model using the redpajama dataset, followed by a
102.
by spmurrayzzz 2y ago
> AFAICT from a quick glance at the code ( https://github.com/qhjqhj00/MemoRAG/blob/main/memorag/memora ...), it is indeed "fine tuning" (jargon!) a model on your chosen book, presumably
103.
by spmurrayzzz 2y ago
FWIW Their most expensive flex price I've ever seen for 80GB A100 was $0.00130 back in January of this year, which is still cheaper albeit by a smaller magnitude, if that's helpful at all for your own competitive market analysis.
104.
by spmurrayzzz 2y ago
> Yes RunPod does have cheaper pricing than us however they don't allow you to specify your exact resources but rather charge you the full resource (see example of A100 above) so depending on your resource requirements our pricing c
105.
by spmurrayzzz 2y ago
The premier open weight models don't even comparatively perform well on the public benchmarks compared to frontier models. And that's assuming at least some degree of benchmark contamination for the open weight models. While I don
106.
by spmurrayzzz 2y ago
> Producing copyrighted things isn’t illegal That isn't true, strictly speaking. The right to reproduce work is covered by copyright law, irrespective of whether the reproduction is commercial or not.
107.
by spmurrayzzz 2y ago
I agree with respect to admiring it from afar. I've gone through large chunks of the source many times and always have an appreciation for what it does and how it accomplishes it. It has a great, supportive community around it as well
108.
by spmurrayzzz 2y ago
Relevant to the original inquiry — I really admire that you bring up the etcd and consul comparison right up front in the readme. For my own comprehension at least, it makes obvious the type of workloads for which you're optimizing and
109.
by spmurrayzzz 2y ago
I can't speak for all use cases, but I've done a great deal of work in the space of using deep learning approaches for anomaly detection in network device telemetry. In particular with high resolution univariate time series of lat
110.
by spmurrayzzz 2y ago
I would argue this post (and the majority of resultant comments) have demonstrated that programmers staying relevant isn't as difficult as it seems. They were curious about how to pivot, had a forum in which they could ask, and in minu
111.
by spmurrayzzz 2y ago
There is so much in the ML world that's being built in the open which you can use as a foundation for your learning. Some folks here already mentioned Jeremy Howard's fast.ai course which is absolutely a great place to start for a
112.
by spmurrayzzz 2y ago
marimo is very good, been using it for a few months now and have switched over to it for most of my notebook-related tasks (it ships with copilot support) https://github.com/marimo-team/marimo
113.
by spmurrayzzz 2y ago
Are you saying that the torch performance with MPS support enabled didn't meet your performance expectations? Or are you using an intel macbook and/or one with a tiny amount of ram/vram?
114.
by spmurrayzzz 2y ago
Quite a few router OEMs do this these days. Its often a bespoke fork of openwrt so they can add their own features (OTA upgrades, web ui customization, etc), but still openwrt under the hood.
115.
by spmurrayzzz 2y ago
Speaking for myself (and I guess anyone else dealing with pcie riser hell in on-prem deep learning setups), its nice to see the massive orgs dealing with pretty much the same exact pain points as not-so-massive orgs.
116.
by spmurrayzzz 2y ago
> cohere's Command R+ is also available and while less capable, for instruction following, I believe its superior to Anthropic's models My experience recently is that its actually noticeably better for instruction following tha
117.
by spmurrayzzz 2y ago
The grandstanding definitely got in the way of otherwise legitimate feedback/concerns about the feature, as sadly tends to be the case in open source software when the mob descends.
118.
by spmurrayzzz 2y ago
Can you expand on this a bit? My recent experiences with MLX have been really positive, so I'm curious what footguns you're alluding to here. (I don't do most of my work locally, but for smaller models its pretty convenient t
119.
by spmurrayzzz 2y ago
> In fact you deliberately asked for something impossible and hold up undefined behavior as undefined like it's impugning something. Correct, I did. This is a direct indictment on a given model's ability to plan/reason in
120.
by spmurrayzzz 2y ago
I love to ask it to "make me a Node.js library that pings an ipv4 address, but you must use ZERO dependencies, you must only the native Node.js API modules" The majority of models (both proprietary and open-weight) don't unde

More ›