otoolep

9 ms·

91.
by otoolep 2y ago
I wrote about this too[1], and since rqlite[2] puts a HTTP API in front of SQLite, you've got a SQLite-backed search engine available over the network. [1] https://www.philipotoole.com/building-a-highly-available-sea...
92.
by otoolep 2y ago
Or, I should say, I don't add the feature until I can figure out how it can made be easy and intuitive to use. That's assuming the feature is even coherent with the existing feature set of the database. Of course, it's easy
93.
by otoolep 2y ago
>They care less about impressive benchmarks or clever algorithms, and more about whether they can operate and use a database efficiently to query, update, analyze, and persist their data with minimal headache. Hugely important, and I wou
94.
Show HN: rqlite and Docker and SQLite-vec – highly-available Vector Search
2 points by otoolep 2y ago|0 comments
95.
by otoolep 2y ago
>I'm curious whether you've had concerns about write amplification though? I mean, yes, the more disk IO rqlite has to make to more write performance will be affected. However the advantages of running with an on-disk SQLite da
96.
by otoolep 2y ago
>You could just use sqlite with :memory: for the Raft FSM That's the basic design that rqlite[1] had for its first ~7 years. :-) But rqlite moved to on-disk SQLite, since with WAL mode, and with 'PRAGMA synchronous=OFF' [2
97.
by otoolep 2y ago
As for your second question, I don't think you'd benefit much from than that, for two reasons: - rqlite is a Raft based system, with quorum requirements. Running 2-node systems don't make much sense. [1] - Secondly, all write
98.
by otoolep 2y ago
It depends on what kind of transaction support you want. If your transactions need to span rqlite API requests then no, rqlite doesn't support that (due to the stateless nature of HTTP requests). That sort of thing could be developed,
99.
by otoolep 2y ago
rqlite author here, happy to answer any questions.
100.
rqlite 8.27: loadable SQLite extensions support(philipotoole.com)
4 points by otoolep 2y ago|0 comments
101.
by otoolep 2y ago
Transactions -- or the lack thereof -- have nothing to do with the consistency guarantees offered by rqlite. You may wish to read this: https://github.com/wildarch/jepsen.rqlite/blob/main/doc/blog...
102.
by otoolep 2y ago
Can you be more specific? "Evidence Dump Fallacy." This fallacy occurs when a person claims that a certain proposition is true but, instead of providing clear and specific evidence to support the claim, directs the questioner to a
103.
by otoolep 2y ago
Wow, a lot there. Thanks for your comments. >One of the problems is if you're working with developers, the log replication contents is the queries, instead of the sqlite WAL like in dqlite. I think you mean rqlite does "stateme
104.
by otoolep 2y ago
rqlite creator here. That's clearly a mistaken attitude because both Consul and etcd also use a single "Raft group" and they are production-grade software. Ruling out a piece of software simply because it doesn't "s
105.
by otoolep 2y ago
Ah yes. If you are accessing the SQLite files directly I cannot be sure what you will see during the snapshotting. I haven't tested that, since accessing the SQLite files underneath rqlite is not officially supported.
106.
by otoolep 2y ago
Thanks for the question, but I don't follow it -- I don't see any data staleness if you query rqlite during snapshotting. Granted the blog post doesn't go into every single detail, so this might be hard to follow. Can you exp
107.
by otoolep 2y ago
Agreed, in the sense that while rqlite has a lot in common with etcd (and Consul too -- Consul and rqlite share the same Raft implementation[1]) rqlite's primary use case is not about making it easy to build other distributed systems o
108.
by otoolep 2y ago
Just to be clear, rqlite is not a library. It's a complete RDBMS. rqlite has everything you need to read and write data, and backup, maintain, and monitor the database itself. It's not just a library (unlike, say, dqlite).
109.
by otoolep 2y ago
I usually bump the major version number anytime I introduce important new functionality, major performance improvements, or a major new design change. While the API hasn't changed in years, the underlying implementation and file layout
110.
by otoolep 2y ago
rqlite creator here. That's a mischaracterization. rqlite has been in development for 10 years[1], it's a long-running project and its design goals have never changed. The API hasn't changed in a breaking fashion since 2016 a
111.
by otoolep 2y ago
Oh, I also presented some performance numbers in a presentation to a CMU a couple of years back. A little out-of-date, but gives a order-of-magnitude sense. https://youtu.be/JLlIAWjvHxM?t=2690 The biggest performance improv
112.
by otoolep 2y ago
rqlite creator here. That's correct, there is a write-performance hit for the reasons you say. All Raft systems will take the same hit, and SQLite is intrinsically single-writer -- nothing about rqlite changes that[2]. That said, there
113.
by otoolep 2y ago
rqlite creator here. One notable production user is Replicated: https://www.philipotoole.com/replicated-postgres-to-rqlite/
114.
Building rqlite 9.0: Cutting disk usage by half(philipotoole.com)
197 points by otoolep 2y ago|43 comments
115.
The Case for AI Optimism(nationalaffairs.com)
1 points by otoolep 2y ago|0 comments
116.
by otoolep 2y ago
Thanks again to @eatonphil, for the opportunity to talk at Hacker Nights. Online meetings, like the ones Phil organized, were really important between 2020 and 2022.
117.
The New ChatGPT Offers a Lesson in A.I. Hype(nytimes.com)
4 points by otoolep 2y ago|0 comments
118.
Before Goop: the 1970s roots of wellness(bbc.com)
4 points by otoolep 2y ago|1 comments
119.
by otoolep 2y ago
rqlite creator here. There was a Jepsen- style analysis done with rqlite[1] 2 years ago: https://www.philipotoole.com/testing-rqlite-read-consistency... The report itself: https://github.com/wildarch/j
120.
Man who received first pig kidney transplant dies(bbc.com)
2 points by otoolep 2y ago|0 comments

More ›