losfair

10 ms·

91.
by losfair 4y ago
Hi mrkurt! Litestream/LiteFS are amazing projects. The FUSE-based approach is interesting (I'm implementing something similar in mvSQLite, thanks for the idea!) > Graceful failure mvSQLite is designed to continue to operate und
92.
by losfair 4y ago
Hi otoolep, thanks for the corrections! Actually I've just made a few changes to the wiki page before this comment :) rqlite's readme seems to indicate that it uses Consul only for service discovery, and runs Raft internally? I th
93.
by losfair 4y ago
FoundationDB handles the hard part! It provides monotonic "versionstamps", externally consistent transactions, along with other useful features. I recommend FDB's architecture docs: https://apple.github.io/fou
94.
by losfair 4y ago
I'm working on the benchmarks. There shouldn't be surprising results with read scalability, as it is basically guaranteed by FoundationDB. For writes it is indeed more complicated and a benchmark would help here.
95.
by losfair 4y ago
> I love the use case of querying SQLite from a CDN with range requests Author here. Actually I have a similar idea with mvSQLite. Provide a client-side-queryable API, but read-write instead of read-only. Security can be implemented with
96.
Turning SQLite into a Distributed Database(univalence.me)
347 points by losfair 4y ago|71 comments
97.
by losfair 4y ago
There's a page in the wiki doing the comparison: https://github.com/losfair/mvsqlite/wiki/Comparison-with-dql...
98.
by losfair 4y ago
SQLite is a powerful SQL query engine. When combined with a rock-solid distributed storage layer, we get a distributed SQL database, just like what systems like Aurora and Neon have managed to build on MySQL and PostgreSQL.
99.
by losfair 4y ago
Came over this article as I was looking for interesting resources in the SQLite ecosystem. I'm building mvsqlite ( https://github.com/losfair/mvsqlite ), as an attempt to turn SQLite into a proper distributed (not j
100.
SQLite is not a toy database (2021)(antonz.org)
267 points by losfair 4y ago|114 comments
101.
Forbidden files – Files that cannot be created on windows(github.com)
4 points by losfair 4y ago|0 comments
102.
Volume Expansion and Snapshot Restores(fly.io)
1 points by losfair 4y ago|0 comments
103.
Lucky-commit – Customize your Git commit hashes(github.com)
2 points by losfair 4y ago|0 comments
104.
SPAR19 Is Most-Tracked Plane on FlightRadar24(bloomberg.com)
4 points by losfair 4y ago|0 comments
105.
ClockBound – Generate and compare bounded timestamps(github.com)
1 points by losfair 4y ago|0 comments
106.
by losfair 4y ago
Yes it's the serializable isolation level. For applications targeting upstream SQLite, mvsqlite enables pessimistic locking by default - when a transaction is promoted to EXCLUSIVE, it acquires a one-minute lock lease from mvstore. At
107.
by losfair 4y ago
I think Kafka is enough for this use case? FDB should work too but sounds like overkill.
108.
by losfair 4y ago
> Therefore, the modifications from a transaction will be applied in place in these pages. With mvsqlite it is applied to the transaction's own snapshot of the database. Changes are not visible globally until transaction commit. T
109.
by losfair 4y ago
mvsqlite doesn't rely on the SQLite WAL or rollback journal for safety. Actually, it enforces journal_mode=memory! The atomic commit semantics is guaranteed by FDB instead. The limit on max number of open DBs looks low, but maybe short
110.
by losfair 4y ago
I guess "partition" is the better wording. Updated my comment.
111.
by losfair 4y ago
It already works! There are steps to try it in readme.
112.
by losfair 4y ago
Replication is handled by FDB so you don't need to care about it on the application level. These databases can contain partitioned data of your application, like one DB per user, so that a transaction on only user A and another one on
113.
by losfair 4y ago
Yes it's correct! mvsqlite integrates as a custom VFS underlying SQLite's query engine, and SQLite ecosystem stuff can be used on top of it.
114.
by losfair 4y ago
TLDR: The conflict range is the entire SQLite database. mvsqlite does not support concurrent read-write transactions to the same DB. If multiple RW transactions with overlapping [read_version, commit_version] ranges are are requested to be
115.
Show HN: Distributed SQLite on FoundationDB(github.com)
150 points by losfair 4y ago|42 comments
116.
Show HN: Mvsqlite – Distributed, MVCC SQLite That Runs on FoundationDB(github.com)
2 points by losfair 4y ago|3 comments
117.
Show HN: Blueboat is an all-in-one, multi-tenant serverless JavaScript runtime(blueboat.io)
123 points by losfair 4y ago|51 comments
118.
Show HN: Blueboat – All-in-one, multi-tenant serverless JavaScript runtime(blueboat.io)
2 points by losfair 4y ago|0 comments
119.
by losfair 4y ago
TLS is available in pre-shared key (PSK) mode. Looks like there is ongoing work to add TLS-PSK to Go's standard library: https://github.com/golang/go/issues/6379#issuecomment-117006...
120.
by losfair 4y ago
Nice project! I'm wondering why you choose to implement your own cryptography routines instead of using something standard like TLS. Apparently your `DecryptData` and `Encrypt` methods are vulnerable to replay attacks due to a lack of

More ›