zknill

6 ms·

31.
How to make SSE token streams resumable, cancellable, and multi-device(zknill.io)
1 points by zknill 5mo ago|0 comments
32.
How to make SSE token streams resumable, cancellable, and multi-device(zknill.io)
81 points by zknill 5mo ago|12 comments
33.
How to make SSE token streams resumable, cancellable, and multi-device(zknill.io)
1 points by zknill 5mo ago|0 comments
34.
How to make SSE token streams resumable, cancellable, and multi-device(zknill.io)
2 points by zknill 5mo ago|0 comments
35.
How to make SSE token streams resumable, cancellable, and multi-device(zknill.io)
2 points by zknill 5mo ago|0 comments
36.
How to build advanced features for AI chatbots on SSE(zknill.io)
1 points by zknill 6mo ago|0 comments
37.
Is it easy to build advanced AI features on SSE?(zknill.io)
1 points by zknill 6mo ago|0 comments
38.
by zknill 6mo ago
AI generated code, where the author doesn't understand the code, shifts the burden of checking quality and function onto the reviewer. This post says little about that, and suggests some improvements the _reviewer_ can make. I think th
39.
SSE token streaming is easy, they said(zknill.io)
1 points by zknill 6mo ago|0 comments
40.
by zknill 6mo ago
I wrote about "All your agents are going async"[1], and everyone said "Can't you just do this with SSE". So I figured I'd dig into that claim. [1]: https://news.ycombinator.com/item?id=47832720
41.
SSE token streaming is easy, they said(zknill.io)
1 points by zknill 6mo ago|1 comments
42.
by zknill 6mo ago
This is great, I built a manual integration based on JMAP and CalDav cli tooling, but this is neat. Especially: > The OAuth consent screen will give you a choice of three levels of access: read-only (see emails, contacts, calendars), wri
43.
by zknill 6mo ago
I suspect the answer is that the AI chat-app is built so that the LLM response tokens are sent straight into the HTTP response as a SSE stream, without being stored (in their intermediate state) in a database. BUT the 'full' respo
44.
by zknill 6mo ago
> "and which ones are no longer relevant." This is absolutely the hardest bit. I guess the short-cut is to include all the chat conversation history, and then if the history contains "do X" followed by "no actual
45.
by zknill 6mo ago
Assuming LROs are "Long running operations", then you kick off some work with an API request, and get some ID back. Then you poll some endpoint for that ID until the operation is "done". This can work, but when you try a
46.
by zknill 6mo ago
I don't know Kitaru too well, but I do know Temporal a bit. The pattern I describe in the article of 'channels' works really well for one of the hardest bits of using a durable execution tool like Temporal. If your workflow s
47.
by zknill 6mo ago
With the approach based on pub/sub channels, this is possible to do if you know the name of the session (i.e. know the name of the channel). Of course the hard bit then is; how does the client know there's new information from the
48.
by zknill 6mo ago
I don't think this is quite right. I do work for a pub/sub company that's involved in this space, but this article isn't a commercial sales pitch and we do have a product that exists. The article is about how agents are
49.
All your agents are going async(zknill.io)
3 points by zknill 6mo ago|0 comments
50.
All your agents are going async(zknill.io)
3 points by zknill 6mo ago|0 comments
51.
All your agents are going async(zknill.io)
134 points by zknill 6mo ago|78 comments
52.
by zknill 7mo ago
This is actually great for *claws. When Anthropic changed their T&Cs to disallow using claude code oauth tokens in the Anthropic Agent SDK, you had a choice between violate the terms or pay a lot more for the model inference using an AP
53.
by zknill 7mo ago
I've been using Kagi for ~18months and your description doesn't match my experience at all. Querying for something like "snowflake json from variant?" in both engines and in google I get a sort-of-right-but-not-really-th
54.
by zknill 7mo ago
You don't need to be committing the prompts you're using. There's a whole bunch of back and forth in the prompts as you refine. That's not useful information. What you should do, is use the context window that you'v
55.
by zknill 7mo ago
Why an MCP? dbos already ships a cli that appears to have the same features. Why an MCP over a skill that gives context on using the cli? https://docs.dbos.dev/python/reference/cli
56.
You Are the Bottleneck(zknill.io)
2 points by zknill 7mo ago|0 comments
57.
If code is cheap, intent is the currency(zknill.io)
2 points by zknill 7mo ago|0 comments
58.
If code is cheap, intent is the currency(zknill.io)
1 points by zknill 8mo ago|0 comments
59.
by zknill 8mo ago
Yeah for sure, the skill leans on the agent being able to identify the intent. I'd say roughly 30% of the time I have to either prompt it to fix the intent, or it will ask me explicitly what the intent is. Without the skill, the commit
60.
If code is cheap, intent is the currency(zknill.io)
4 points by zknill 8mo ago|2 comments

More ›