avinassh

12 ms·

121.
by avinassh 2y ago
My understanding was that th3 mainly does correctness tests. Other test suites are open source and can be used to ensure compatibility
122.
by avinassh 2y ago
Pekka already experimented with MVCC and I expect it to make it to Limbo at some point to enable multiple concurrent writers
123.
by avinassh 2y ago
> One of the nice things about sqlite is that there is a very extensive test suite that extensively tests it. Yes, that sets a high bar for us. We plan to use Deterministic Simulation Testing and Antithesis to reach the rigorous testing
124.
by avinassh 2y ago
> My solution was to have a central function on a timer that read and parsed the files every couple of minutes, loaded the data into a SQLite database, indexed it, and put the file in S3. I really love using S3 as a storage backend!
125.
by avinassh 2y ago
> Let's async all the things IO and not pay attention to database integrity and reliably fsync'ing with storage I am not sure how does this affect database integrity or reliably fsync-ing for e.g. TigerBeetle is another rock so
126.
by avinassh 2y ago
> The web site says "the project does not accept patches from people who have not submitted an affidavit dedicating their contribution into the public domain." I have been always curious about this. Is there any more public inf
127.
by avinassh 2y ago
disclosure: I work at Turso > code of ethics as almost toxic This is simply not true. Can you tell me where it is being said so? > then folding “libSQL into the Turso family” within the year. libSQL was always part of Turso. So, I d
128.
by avinassh 2y ago
I am the author of this blog post and I didn't expect to see it on the front page! For disclosure, I work at Turso and one of the authors, Pekka, is from Turso. This paper came out in April 2024 when Limbo was in its nascent stages. It
129.
by avinassh 2y ago
hey, thats fair. I have mentioned that I work at Turso in my blog's about page, but I don't expect everyone to check that. I have updated the post to include a disclosure, thanks!
130.
In Search of a Faster SQLite(avi.im)
355 points by avinassh 2y ago|149 comments
131.
Making unsafe Rust a little safer(blog.colinbreck.com)
38 points by avinassh 2y ago|10 comments
132.
In Search of a Faster SQLite(avi.im)
15 points by avinassh 2y ago|0 comments
133.
by avinassh 2y ago
As other commenters have already pointed out, SQLite does not take outside contributions. We already have a fork, called libSQL. However, the goals of Limbo are far more ambitious and we cannot rewrite some parts step by step. We want to ha
134.
by avinassh 2y ago
> In any case, the programming language should have little to no impact on the database performance, since the majority of the time is spent waiting on io anyway may be! However, Rust makes some things easier. It is also easy to maintain
135.
by avinassh 2y ago
As of now it has a single writer, same like SQLite. But we plan to add MVCC with multiple writers in the future. Pekka has experimented with MVCC earlier: https://github.com/penberg/tihku
136.
by avinassh 2y ago
disclosure: I work here. I am happy to answer any questions tl;dr We are rewriting SQLite in Rust. It uses Asynchronous I/O, considers WASM as first class, and has Deterministic Simulation Testing support from the beginning. source: h
137.
Limbo: A complete rewrite of SQLite in Rust(turso.tech)
373 points by avinassh 2y ago|232 comments
138.
Galloping Search(avi.im)
1 points by avinassh 2y ago|0 comments
139.
by avinassh 2y ago
it does now: https://github.com/dbeaver/dbeaver-jdbc-libsql
140.
Why Events Are A Bad Idea (for high-concurrency servers) (2003) [pdf](usenix.org)
2 points by avinassh 2y ago|0 comments
141.
by avinassh 2y ago
(author here) definitely! I plan to add a batch write API. Also, an API where it buffers till it reaches certain size or a timeout to write to S3 tracking the batch write here: https://github.com/avinassh/s3-log/is
142.
by avinassh 2y ago
(author here) Currently, there is durability guarantee. The call returns only after successful write to S3. This is close to fsync in a single node system. I plan to add a relaxed write mode I am tracking the issue here: https://
143.
by avinassh 2y ago
crazy idea, but SQLite
144.
Zero Disk Architecture for Databases(avi.im)
3 points by avinassh 2y ago|0 comments
145.
by avinassh 2y ago
Hey! I am @avi.im I mostly post stuff about databases, distributed systems and my frustrations with Rust https://bsky.app/profile/avi.im
146.
by avinassh 2y ago
perfect. beautifully designed. I will try this for my next side project.
147.
Nothing-up-my-sleeve number(en.wikipedia.org)
43 points by avinassh 2y ago|12 comments
148.
by avinassh 2y ago
> .::/ whats this magic
149.
by avinassh 2y ago
You would be surprised :) A couple of my friends who work in the financial domain showed surprise at this post - they had no idea this was possible. I guess most people just assume databases 'just work'?
150.
by avinassh 2y ago
SQLite or any other mainstream database like Postgres don't do checksums. Wouldn't you be concerned if you are using it for financial data or medicine or something crucial?

More ›