carlsverre

9 ms·

91.
by carlsverre 3y ago
Currently it's full db sync. Partial replication is in research.
92.
by carlsverre 3y ago
First, thanks! > It isn't clear how they manage the subscription to data updates/inserts/deletions - it mentions supporting triggers, but that feels icky to me. Architecture post coming soon. In the meantime, I want to cla
93.
by carlsverre 3y ago
That's the dream! Currently SQLSync wraps SQLite in a fairly heavy weight way as it needs to both intercept the storage tier (to replicate page changes) as well as the mutation layer (to provide the reducer api). I'm interested in
94.
by carlsverre 3y ago
Good question. First to address the main point: why not cache the relevant bits in some kind of local storage. SQLSync plans on doing this, specifically using OPFS for performance (but will have fallbacks to localstorage if needed). Second
95.
by carlsverre 3y ago
I'm also interested to find out if it's cursed :) So far it's been a lot better than I expected. Apps like https://sqlsync-todo.pages.dev are trivialised with this pattern. Tons of work to do in order to really pr
96.
by carlsverre 3y ago
This is cool! Thanks for sharing. Sounds like Fuse would be a great solution for a read-only index. But what if you want to collaborate on the data with other people? FWIW check out SQLite's full text search extension: https:/&#x
97.
by carlsverre 3y ago
That's a great way to accomplish local storage, but requires a bit of gymnastics to build sync. By controlling the database entirely, SQLSync can provide very ergonomic sync to the developer and performance for the user. So it's n
98.
by carlsverre 3y ago
Precisely! The same database (SQLite) is running on both the client and the server. SQLSync provides a custom storage layer to SQLite that keeps everything in sync. As changes are made locally (optimistically) they are synced into the cloud
99.
by carlsverre 3y ago
Good catch! SQLSync runs in a shared worker to enable cross-tab reactivity and centralise both local storage and the replication system. You can inspect the worker at the magic url: chrome://inspect/#workers
100.
by carlsverre 3y ago
Totally fair question. Nothing is set in stone - but this approach made it very easy for me to run precisely the same code on both a generic backend (CloudFlare Durable Objects) and in the frontend stack. As for wasm-in-wasm specifically. I
101.
Thoughts on Handmade Seattle 2023(carlsverre.com)
3 points by carlsverre 3y ago|0 comments
102.
The disaggregated write-ahead log (2023)(blog.schmizz.net)
7 points by carlsverre 3y ago|0 comments
103.
by carlsverre 3y ago
This is super fun to play with. Adding instructions at different points in this pattern generates some very cool overlay effects. [[[[[[FFCFFFFFFFFFCCCCCCC[[[FFR]]FFR]]]RRRRRCFFFFFFFFFFFFFFFFFFC[[[FFCFFFFFFFFFCCCCCCC[[[FFR]]FFR]]]CCCCCCRRRR
104.
by carlsverre 3y ago
Good questions. I think that at the lowest level, the per document model is a nice abstraction to build on top of. But I have a lot of plans on the cloud side to make it easier to integrate into the rest of your backend and your existing db
105.
by carlsverre 3y ago
Very cool! It would be nice to see a working end to end integration with an LLM. Using this to generate relevant context for example. I see multiple folks mention cos similarity which HNSW doesn’t support - how does the lack of that limit w
106.
Migrating a 2TB database in 7.5 minutes(usefathom.com)
6 points by carlsverre 3y ago|0 comments
107.
by carlsverre 3y ago
The authors have created a specialisation for Postgres that leverages a custom type which is a tuple of type and uuidv7: https://github.com/jetpack-io/typeid-sql/blob/main/sql/typei... This is more
108.
by carlsverre 4y ago
This is a very cool overview! How much data ends up being cached in the postgres compute tier in the steady state? How much does query performance suffer after cold start? Also the video in the post doesn't play for me (and is a bit to
109.
by carlsverre 4y ago
Very cool! Thanks :) QUIC seems like a solid simplification for sure.
110.
by carlsverre 4y ago
Very cool! Was there anything additional you had to do in the network stack to preserve active TCP connections? Being able to do a live migration without dropping connections is fantastic!
111.
by carlsverre 4y ago
Heck yes - this is the way. Make this available and you will unlock an entirely new ecosystem of CF worker plugins. A++
112.
by carlsverre 4y ago
This is a good idea... how much compute does SSL client cert auth require on the client side? I would suppose it has to produce a signature of some kind, perhaps signing a challenge from the server?
113.
by carlsverre 4y ago
Pretty insightful observation on authentication. Using a password method that requires the client to compute a brute force resistant hash that takes ~100ms of cpu time is a non-starter for most serverless platforms. I'm curious if Clou
114.
Edge-compatible Serverless Driver for Postgres(neon.tech)
69 points by carlsverre 4y ago|44 comments
115.
Building a SaaS in 2022(charliejoseph.com)
2 points by carlsverre 4y ago|0 comments
116.
I built a universe simulation running in SingleStore(github.com)
2 points by carlsverre 4y ago|0 comments
117.
Laravel Connector for SingleStore(singlestore.com)
1 points by carlsverre 4y ago|0 comments
118.
Making the world’s fastest analytics even faster(usefathom.com)
2 points by carlsverre 5y ago|0 comments
119.
Your phone already has Bottomless(singlestore.com)
1 points by carlsverre 5y ago|0 comments
120.
by carlsverre 5y ago
Any technical blog post is only as good as the code, so I encourage you to check it out here: https://github.com/singlestore-labs/singlestore-logistics-si... . You can spin it up on your computer using Docker or you ca

More ›