raoufchebri

10 ms·

1.
Fork Buckets Like You Fork Code(tigrisdata.com)
2 points by raoufchebri 1y ago|0 comments
2.
by raoufchebri 2y ago
Here is an article about PITR in Neon https://neon.tech/blog/point-in-time-recovery-in-postgres
3.
by raoufchebri 3y ago
Here is a step by step guide on how to deploy Mistral Large to Azure: https://neon.tech/blog/deploy-mistral-large-to-azure-and-cha...
4.
by raoufchebri 3y ago
Excited about the Microsoft partnership
5.
by raoufchebri 3y ago
Last November, we had several outages and have since directed much of our engineering efforts towards improving stability. During this phase, cold start latency regressed, but the root cause and magnitude were not immediately apparent to us
6.
Local AI with Postgres, pgvector and llama2, inside a Tauri app(electric-sql.com)
3 points by raoufchebri 3y ago|0 comments
7.
by raoufchebri 3y ago
Really cool. Do you see this being integrated into PostgreSQL in the future with the rise of open-source LLMs?
8.
by raoufchebri 3y ago
Neon is cloud-native Postgres with a storage system written in Rust and a persistence layer stored in AWS S3. Because the cloud storage layer is decoupled from the rest of the architecture, you can bring your own S3.
9.
by raoufchebri 3y ago
We’re excited to announce the release of logical replication on Neon to stream your data to external data stores, allowing for change data capture and real-time analytics.
10.
by raoufchebri 3y ago
How do you handle conflict with pgvector's hnsw if you want to install both extensions ? CREATE INDEX semantic_image ON image_table USING hnsw (v dist_cos_ops) WITH (M=5, ef=30, ef_construction=30, dims=512);
11.
by raoufchebri 3y ago
Awesome idea! like the UI
12.
by raoufchebri 3y ago
The index doesn't need to fit in the shared buffers to be built, but you can speed the queries if you load it to memory
13.
by raoufchebri 3y ago
It's under Apache license
14.
by raoufchebri 3y ago
We used 1M vectors of 1536 dimensions (OpenAI). The index size was ~6GB.
15.
by raoufchebri 3y ago
We tested pgvector’s implementation of HNSW for you and compared it to pg_embbeding’s. This covers why this milestone is important for Postgres and why Neon is committed to supporting pgvector.
16.
PostgreSQL in 100 Seconds by Fireship [video](youtube.com)
2 points by raoufchebri 3y ago|0 comments
17.
by raoufchebri 3y ago
I think you can find Qdrant here https://ann-benchmarks.com/glove-100-angular_10_angular.html This is different from the dataset we used. We used GIST-960. It could interesting to test different vector store indeed.
18.
by raoufchebri 3y ago
Adding https://ann-benchmarks.com/
19.
by raoufchebri 3y ago
@jonathan-adly do you use ivfflat with pgvector?
20.
by raoufchebri 3y ago
Hey @lysecret, what's your use-case?
21.
by raoufchebri 3y ago
Blog post author here. Let me know if you have any questions regarding the benchmark and pg_embedding
22.
by raoufchebri 3y ago
Neon separates storage and compute. The compute part is serverless and can scale up and down on demand. The storage has multiple layers: Safekeepers for durability and Pageservers to reconstruct pages from WAL. The data is also offloaded to
23.
by raoufchebri 3y ago
Thanks, I didn't know about serverless-pg. I'll have a look.
24.
by raoufchebri 3y ago
Connection caching is achieved on proxy side. Edge <-> Proxy<->Compute(Postgres)
25.
by raoufchebri 3y ago
Thank you. We fixed it now.
26.
by raoufchebri 3y ago
Hey @PaulWaldman, can you tell us more about your use case with gRPC and Postgres?
27.
by raoufchebri 3y ago
> I'd love to know what fraction of the time is spent in processing, transit, querying the db, etc. We experimented with SELECT 1, so most of the latency is transit
28.
by raoufchebri 3y ago
Yeah! these are just normal websockets. We're definitely interested in supporting and testing more protocols and ways of accessing postgres and neon as we can. We're also super excited to see the development and adoption of new pr
29.
by raoufchebri 3y ago
We use a proxy that redirects the request to the compute node. The proxy uses WebSockets in this case. https://neon.tech/blog/serverless-driver-for-postgres
30.
by raoufchebri 3y ago
We have only compared on Vercel Edge and Serverless environments. I think it makes a lot of sense to compare our driver to pg on CF with connect.

More ›