15 ms·
Postgres.new: In-browser Postgres with an AI interface
hey HN, supabase ceo here
This is a new service that we're experimenting with that uses PGLite[0], a WASM build of Postgres that runs in the browser. You might remember an earlier WASM build[1] that was around ~30MB. The Electric team [2] have gone one step further and created a complete build of Postgres that’s under 3MB.
Their implementation is technically interesting. Postgres is normally multi-process - each client connection is handed to a child process by the postmaster process. In WASM there’s limited/no support for process forking and threads. Fortunately, Postgres has a relatively unknown built-in “single user mode” [3] primarily designed for bootstrapping a new database and disaster recovery. Single-user mode only supports a minimal cancel REPL, so PGlite adds wire-protocol support which enables parametrised queries etc.
We have created https://postgres.new https://postgres.new as an experiment. You can think of it like a love-child between Postgres and ChatGPT: in-browser Postgres sandbox with AI assistance. You can spin up as many new Postgres databases as you want because they all live inside your browser. We pair PGlite with an LLM (currently GPT-4o) and give it full reign over the database with unrestricted permissions. This is an important detail - giving an LLM full autonomy means that it can run multiple operations back-to-back: any SQL errors from Postgres are fed back to the language model so that it can have a few more attempts to solve the problem. Since it’s in-browser it’s low risk.
Some other features include:
- CSV upload: you can upload a CSV and it will automatically create a Postgres table which you can query with natural language.
- Charts: you can ask the LLM to create a chart with the data and change the colors of the charts.
- RAG / pgvector: PGLite supports pgvector, so you can ask the LLM to create embeddings for RAG. The site uses transformers.js [4] to create embeddings inside the browser.
We’re working on an update to deploy your databases and serve them from S3 using pg-gateway [5]. We expect to have a read-only deployments ready by the end of the week. You can access them using any postgres-compatible tool (eg: psql).
Everything is open source. A huge shout-out to the Electric team who have been a pleasure to build with.
[0] PGLite: https://github.com/electric-sql/pglite https://github.com/electric-sql/pglite
[1] Postgres-wasm: https://supabase.com/blog/postgres-wasm https://supabase.com/blog/postgres-wasm
[2] Electric: https://electric-sql.com/ https://electric-sql.com/
[3] Single user mode: https://www.postgresql.org/docs/current/app-postgres.html#APP-POSTGRES-SINGLE-USER https://www.postgresql.org/docs/current/app-postgres.html#AP...
[4] transformers.js: https://github.com/xenova/transformers.js https://github.com/xenova/transformers.js
[5] pg-gateway: https://github.com/supabase-community/pg-gateway https://github.com/supabase-community/pg-gateway
- deleted 2y ago[deleted]
- samwillis 2y agoHey Sam from Electric here, I work on PGlite What the team at Supabase have built with postgres.new is incredible, it has been a lot of fun to work with them on it over the last month or so. It's fead directly back into the development of PGlite and helped us iron out some bugs and finish hitting the feature list required. SQL databases and LLMs go together so incredible well, the structured data and schema enables an LLM to infer so much context about the database and the underlying data. This exploration into a UI over this paring is going to be incredibly influential, it opens up what has traditionally been a complex technical problem to everyone. That's the true power of LLMs. I'm not going to go on about PGlite here as postgres.new really deserves the limelight!
- deleted 2y ago[deleted]
- localfirst 2y agowhich mobile browsers can this run on? seems like its not happening on Safari on iPhone. If it did that would be a game changer. Any status on whether ElectricSQL can run on mobile devices in general? also is the UI tool open source? id prefer to run it locally edit: this is an incredible tool. its going to eat a lot of backend engineers billing hours. suggestion: add a copy button for the generated SQLs
- kiwicopple 2y agoEverything is open source with the exception of the LLM at the moment, which we'll get to. Here are all the tools: * postgres-new (https://github.com/supabase-community/postgres-new https://github.com/supabase-community/postgres-new): The frontend. Apache 2.0 * PGlite (https://github.com/electric-sql/pglite https://github.com/electric-sql/pglite): A WASM build of Postgres. Apache 2.0 * pg-gateway (https://github.com/supabase-community/pg-gateway https://github.com/supabase-community/pg-gateway): Postgres wire protocol for the server-side. MIT * transformers.js (https://github.com/xenova/transformers.js https://github.com/xenova/transformers.js): Run Transformers directly in your browser