paulgb

7 ms·

61.
by paulgb 2y ago
Only if you give it unfettered accesss. AWS has an API called AssumeRole which can generate short-lived credentials with a specifically scoped set of permissions, which I use instead.
62.
by paulgb 2y ago
Thanks, I’ll send you an email!
63.
by paulgb 2y ago
ChatGPT's code interpreter is mostly used as a calculator / graphing calculator. It can run arbitrary Python code, but it is limited in practice because it can't (e.g.) make external web requests or install arbitrary packages
64.
by paulgb 2y ago
We allow outgoing requests because a common use case of ForeverVM is making API calls or fetching data files (the "fetch and analyze data" button shows an example of this). We give every repl its own network namespace and virtual
65.
by paulgb 2y ago
Good insight! We also initially tried to use Jupyter as a base but found that it had too much complexity (like the widgets you mention) for what we were trying to do and settled on something closer to a vanilla Python repl. This really simp
66.
by paulgb 2y ago
Fair enough. Our audience is businesses rather than consumer, so our equivalent to self-hosting is that we can run it in a customer's cloud. We mention Claude a lot because it is a good general coding model, but this works with any LLM
67.
by paulgb 2y ago
It was an afternoon to prototype, followed by a lot of work to make it scale to the point of giving everyone who lands from HN a live CPython process ;)
68.
by paulgb 2y ago
Also, those code interpreters usually can't make external network requests, which is adds a lot of capabilities like pulling some data, and then analyzing it.
69.
by paulgb 2y ago
It's not exposed in the API yet, but it's very possible with the architecture and something we plan to expose. I am curious if you have a use case for that, because I've been looking for use cases! Being able to fork the chat
70.
by paulgb 2y ago
You're right that LLM context is the limiting factor here, and we generally don't expect machines to be used across different LLM contexts (though there is nothing stopping you). The utility here is mostly that you're not pay
71.
by paulgb 2y ago
Yes, I've found that just having the MCP server installed, now when I ask a question about Python, Claude becomes eager to check its work before answering Python questions (Claude does have a built in analysis tool, but it only runs Ja
72.
by paulgb 2y ago
We are working now on support for arbitrary imports of public packages from PyPi, which will include cython support, but only for public pypi packages. Soon after that we'll be working on a way to provide proprietary packages (includin
73.
by paulgb 2y ago
The API could be used for non-AI use cases if you wanted to, but it’s built to be integrated with an LLM through tool calling. We provide an MCP (model context protocol, for integration in Claude, Cursor, Windsurf etc.) server.
74.
by paulgb 2y ago
Good question, we’ll add some info to the page for this. LLMs are generally quite good at writing code, so attaching a Python REPL gives them extra abilities. For example, I was able to use a version with boto3 to answer questions about an
75.
ForeverVM: Run AI-generated code in stateful sandboxes that run forever(forevervm.com)
184 points by paulgb 2y ago|52 comments
76.
The Moped King(streetsblogprojects.org)
21 points by paulgb 2y ago|9 comments
77.
by paulgb 2y ago
I think OP means stay up on HN, the controversy catcher will probably be triggered by comments / flags soon.
78.
by paulgb 2y ago
DOGE is not the audience of this.
79.
by paulgb 2y ago
It’s only going to get cheaper over time. It’s already cheap enough that if these services disappeared overnight I’d switch to an open source alternative with a local model. The industry needed VC backing to pay the fixed cost of the resear
80.
by paulgb 2y ago
This looks great, can't wait to try it out!
81.
by paulgb 2y ago
Also, he was quote-tweeting something that referred to slashing IRS Direct File, which is probably one of the most no-brainer efficiency improvements the government could make. The main reason it's been opposed for so long is just beca
82.
by paulgb 2y ago
This is moving the goalpost on what "killer app" means. Code assistants are a compelling use of the tech that has quickly shown real-world value, which is the point I'm trying to make here. Whether the companies that are lead
83.
by paulgb 2y ago
I think autocomplete alone would be enough to make coding a killer app for AI. I agree the tools are overhyped for allowing non-developers to write code. It’s not (today) a replacement for a dev agency that takes a set of requirements and r
84.
by paulgb 2y ago
> And even then, we still don't have a killer app! There is no product that everybody loves, and there is no iPhone moment! I would strongly argue that coding assistants are AI’s first killer app. Copilot, Cursor, Windsurf etc.
85.
by paulgb 2y ago
> Twitter's content policy is more permissive now than it was pre-aquisition, with only narrow exceptions (e.g. doxxing is now banned). Part of the problem is that the “content policy” keeps differing from practice. Does sharing Sig
86.
by paulgb 2y ago
During his last administration, Trump nominated Barry Myers to head NOAA. Myers lobbied for AccuWeather, attempting to prevent NOAA from publishing data that would compete with AccuWeather. He was also notable for not having a scientific ba
87.
by paulgb 2y ago
For context, the file is linked from here: https://www.weather.gov/news/241908-weather-radars
88.
NOAA: File is deleted by executive order [pdf](noaa.gov)
60 points by paulgb 2y ago|19 comments
89.
by paulgb 2y ago
2023 is also fine. When I posted it did not say 2021 or 2023 which made it look recent.
90.
by paulgb 2y ago
In case anyone is (like me) unfamiliar with the server header ad: https://news.ycombinator.com/item?id=15237923 Glad they removed it. Caddy is a great piece of software.

More ›