kentonv

12 ms·

61.
by kentonv 3mo ago
The code currently supports Anthropic, OpenAI, Gemini, Workers AI, and ollama as AI providers. It additionally optionally supports sending all requests through Cloudflare AI Gateway as a proxy. The same set of providers is supported either
62.
by kentonv 3mo ago
Flue is actually also built on Pi. We are big Pi fans at Cloudflare. Cloudflare OS uses pi-agent-core, but not pi-coding-agent. pi-agent-core, at least the way CFOS uses it right now, is more of an LLM API compatibility layer than a full ha
63.
by kentonv 3mo ago
You beat us to it! Been meaning to land this but got distracted. https://github.com/cloudflare/workerd/pull/6780 But honestly I love that there are multiple implementations now.
64.
by kentonv 3mo ago
Not intentionally, we just haven't gotten around to expanding the provider list beyond what we use regularly. There is ollama (local LLM) support in there. But we'll probably expand it to everything pi-agent-core supports, just ne
65.
by kentonv 3mo ago
wrangler is a development tool. You wouldn't want to run dev mode in production. But workerd can be used directly without wrangler, and is production-capable in that format. Unfortunately we did not have time to put together example co
66.
by kentonv 3mo ago
In theory Wasm could be supported, but generally JS/TS is much more efficient when running inside isolates (our lightweight sandboxes) since you don't have to bundle a language runtime into the app. CFOS at present only exposes JS
67.
by kentonv 3mo ago
Incorrect. You can host it on workerd on your own servers. No Cloudflare required.
68.
by kentonv 3mo ago
No, a Gadget does not just get automatic access to your data. It only gets access to the things you grant it explicitly.
69.
by kentonv 3mo ago
> It doesn’t schedule tasks, It absolutely does. > doesn’t deal with physical memory, Well it sort of does. It allocates sandboxes and schedules apps in them. It handles loading code from storage and turning it into running programs w
70.
by kentonv 3mo ago
Mostly to get trolls to retweet and complain about it for free advertising. It's working. ;)
71.
by kentonv 3mo ago
The key is the fine-grained instances (gadgets). E.g. if you're using a slide editor app, each slide deck you create is its own instance of the app, whose code can be independently modified. The slide content and the code are kept toge
72.
by kentonv 3mo ago
https://github.com/cloudflare/cloudflare-os
73.
by kentonv 3mo ago
I tried it as a startup once, so I know what that's like. It's a lot of time spent running around begging for money (from investors and from customers) rather than building technology. Workers is my startup-within-Cloudflare. It w
74.
by kentonv 3mo ago
The blueprint is just code, it does not include data or capabilities. It's, I suppose, possible that the agent added secrets to the code itself. Not, like, API keys -- the agent never sees those. But it could have extracted sensitive i
75.
by kentonv 3mo ago
I'm sorry but Workers is the technology that makes this all possible. I don't think I could have built this without Workers as a foundation. (I tried once, with Sandstorm, and like I said, it didn't work well.) Sometimes you
76.
by kentonv 3mo ago
It's the same code. The only thing it doesn't include is the global scheduling and orchestration, but you don't actually want that locally. (And honestly... that stuff is a bit of a beast.) Durable Objects are fully supported
77.
by kentonv 3mo ago
Use of Cloudflare AI Gateway is optional. In the default configuration, you just plop your Anthropic/OpenAI/Gemini/Workers AI/ollama API keys into the UI and it talks to each provider directly. That said, I would recomme
78.
by kentonv 3mo ago
Gatekeepers can specify the sensitivity of their data. A Gatekeeper can actually flag an observation (a read operation) as being so sensitive that the agent should be prohibited from writing anywhere else after having seen that. This is w
79.
by kentonv 3mo ago
Sandstorm's use of containers was just a means to an end. The real innovation was the fine-grained instances -- each document in its own container. No other container platform did that. But honestly, it didn't work well, because o
80.
by kentonv 3mo ago
Not yet, but that's an obvious direction to take things. :) I'm really excited by the idea that this platform makes it safe to use blueprints that someone else vibe coded, without worrying about whether they checked it for secur
81.
by kentonv 3mo ago
Reads do not require approval. Only writes do. Reads are, however, limited to only the resources you have explicitly attached. Moreover, since agents and gadgets run in a sandbox with essentially no access to the outside world except via ap
82.
by kentonv 3mo ago
We really struggled with how to present this to multiple audiences at once. My tweet thread, and the GitHub readme, is really the presentation intended for the HN crowd. The blog post is for a different audience. https://github.c
83.
by kentonv 3mo ago
To be fair this post came first and the other is a dup. But the dup has gotten way more upvotes so should probably be canonical.
84.
by kentonv 3mo ago
> So you can run it off the public internet with no sneaky external dependency on cloudflare, slack etc? Yes. It even supports ollama and works decently well with some local LLMs. > And it would be functionally the same? With the same
85.
by kentonv 3mo ago
That's why this is open source. https://github.com/cloudflare/cloudflare-os You're supposed to customize it. Also it features a whole system for adding your own skills and context.
86.
by kentonv 3mo ago
This is 100% open source and self-hostable. https://github.com/cloudflare/cloudflare-os It runs on top of our open source runtime. https://github.com/cloudflare/workerd
87.
by kentonv 3mo ago
Or more directly: When you share a Gadget, we verify that anyone you share with also has direct permission to access each of the resources it is connected to (via the Gatekeeper system). Hence, no security bug in the Gadget itself could acc
88.
by kentonv 3mo ago
See my next tweet in the chain: https://x.com/KentonVarda/status/2084990302784307363 ------------- Of course, personal apps are more useful if they can connect to external services. Cloudflare OS introduces a &quo
89.
by kentonv 3mo ago
What do you mean? This is 100% open source and self-hostable! https://github.com/cloudflare/cloudflare-os It runs on the open source Workers Runtime: https://github.com/cloudflare/workerd You can
90.
by kentonv 3mo ago
This is the successor to Sandstorm.io! Hey folks, this was actually my personal side project until a couple months ago. It's Sandstorm.io (my startup from a decade ago) rebuilt on top of Cloudflare Workers (the thing I've spent th

More ›