weitendorf

10 ms·

61.
by weitendorf 3mo ago
If you’re serious about this, let me know! This is something I built for myself, and to experiment with inference stacks. You can obviously just transcribe audio and hand it off to frontier models, so all you really need is a good voice sta
62.
by weitendorf 3mo ago
I think it’ll just become “agentic search” and “information retrieval” again because RAG is too intertwined with a particular kind of implementation/use case of basic document scoring + first gen vector dbs that is IMO undesirable for
63.
by weitendorf 3mo ago
To be honest as someone working in this space for the past two years, the problem with the “RAG” and semantic search community is it’s mostly vendors and solutions people selling simple, general stuff to product teams. If you really are int
64.
by weitendorf 3mo ago
We really wanted to use sqlite-vec for this for our SSG but last we checked it hadn’t implemented HNSW/had good support for running vector search in-browser yet (I think it was still doing full-table scans?). I was pretty disappointed
65.
by weitendorf 3mo ago
I disagree with this pretty strongly. If you’re not going to take responsibility for your bugs I don’t want to work with you. Don’t make other people QA your work; if you’re not able to figure out how to do that yourself while you work you’
66.
by weitendorf 3mo ago
Agree with this and I have been thinking about it recently as well. I think you could implement a cord-like vocabulary to identify large duplicated substrings for exact deduplication and pairwise correlations or vocabulary profiles/sma
67.
by weitendorf 3mo ago
I’ve also had problems with Gemini when accessed through their UI in the past few weeks. That’s concerning that you are also seeing it several days later in a different context. I wonder if there could be a large security situation playing
68.
by weitendorf 3mo ago
How do you test it across different workloads and are you running it in a datacenter or cloud provider? I forgot to mention it but the other major problem I underestimated was giving the permission to potentially spend lots of money to AI c
69.
by weitendorf 3mo ago
IMO asking the AI to prompt itself, remind it to clean up other agents, tell it to monitor something and just hang there for hours, etc gets old really fast. If I had to pay the API rate to have one LLM rewrite what I just told it to anothe
70.
by weitendorf 3mo ago
My company tried to build something like this pre-TUI as a tool-AI-IO dag dispatcher. The biggest mistake I made was thinking that people would have no problem figuring out how they could translate their work or define multi-step automation
71.
by weitendorf 3mo ago
We're working on a browser-harness that makes forking, rpcs, and mapreduce first class tool calling primitives. Among other things, this makes it easier to manage your own context, because you can visualize your agents, subagents, and
72.
by weitendorf 3mo ago
Yes, that's the Internet Consensus and the reddit comment section every time a startup doing anything is mentioned. You should never take a risk, business people are all evil and stupid, you should treat every employment or business op
73.
by weitendorf 3mo ago
I had the opposite reaction, this felt like a story that was literally purpose-built for pandering the hn audience without saying anything interesting. Good fiction teaches you something you hadn't seen before, or challenges your persp
74.
by weitendorf 3mo ago
I built a very similar tool recently mentioned elsewhere in these comments. I think with the current state of LLMs, harnesses, and related tooling, being able to create or setup self-eval tooling is the biggest differentiator between merely
75.
by weitendorf 3mo ago
I think most people who strongly identify with tools like vim do so out of a sense of identity-building to "be the kind of developer who is good at vim" / embody some kind of aesthetic or in-group signal moreso than an actual
76.
by weitendorf 3mo ago
There are multiple developer subcultures (nominally for productivity but mostly hobbyists) pretty much exclusively motivated by installing and configuring complex, visually-dense, high-learning-curve tooling and editor setups driven by the
77.
by weitendorf 3mo ago
I ran into this with my first attempt at building a static site generator "for agents" last year. https://statue.dev I got very frustrated with LLMs and their inability to apply good taste or maintain consistent design
78.
by weitendorf 3mo ago
I have been working on metaparsing and some related tools for spec-based-development, fuzzing, and property-based-testing off and on for the past few months. I hope to make it easier for application developers to get the benefits of formal
79.
by weitendorf 3mo ago
Nothing stops you from writing a formal spec for an implementation or the technical parts of a problem that the product / upstream requirements don't explicitly demand. In fact I would say this is a large part of what software eng
80.
by weitendorf 3mo ago
I endorse this, and IME find there are major benefits to “relaxing” even moreso through reductions or decompositions into well-known models rather than defining your own. A lot of problems in practice are just too complex, too theoretically
81.
by weitendorf 4mo ago
I thought this way until I tried it, and the main difference is that when I'm managing tons of agents at once or just reviewing some plan / approving next steps, or need to give quick feedback/ask a simple followup, the voice
82.
by weitendorf 4mo ago
Sure, my company has been working on a broad swathe of infrastructure projects and developer tools, which requires prompting models to seek out other tools/apis/docs/examples but in a way where we can't just dump all the
83.
by weitendorf 4mo ago
While I agree that the harness is part of it, I think it's also a lack of epistemic understanding or awareness for what it means to actually solve a problem vs just get something kinda working; maybe if Claude Code or other harnesses m
84.
by weitendorf 4mo ago
The parsing thing, or the willingness to instantly drop into janky unsanitized string manipulations, or to constantly push back against work on infra projects because some random package on GitHub has 200 stars so it’s totally the safer app
85.
by weitendorf 4mo ago
One thing I used to test quite a lot was rerunning the exact same prompt on the same input, or semantically equivalent (in my mind) but differently framed or worded input, and seeing how much they diverged. In particular I’ve done this quit
86.
by weitendorf 4mo ago
I think you either need to split your time in between 100% product and 100% marketing or have a founding team that is able to do both - not just “marketing” but the ability to build and leverage a personal + corporate brand and get specific
87.
by weitendorf 4mo ago
> TorchCodec now has a dedicated WavDecoder for decoding WAV files. It bypasses FFmpeg entirely and reads WAV data directly, resulting in significantly faster decoding. I'm working in this area recently and very keen to use this giv
88.
by weitendorf 4mo ago
Work on distributed/federated learning. The main doomsday scenario is exactly what Anthropic is enabling. RSI within a top-down, concentrated power structure creates an unstable equilibrium and will instantly devolve into an epic power
89.
by weitendorf 4mo ago
Unrelated but I’ve been putting off learning about post-abliteration technique and want to use it for an upcoming open source “retraining” project I have on my backlog. I’m not interested in the refusal layers though, more like deep fine tu
90.
by weitendorf 4mo ago
Yes, this is the problem. They are business interests of Anthropic and have nothing to do with “safety”

More ›