apavlo

10 ms·

61.
by apavlo 3y ago
Andy from OtterTune here. I suppose that it is possible to do something like this. We've explored the idea of synthesizing a workload that behaves like an application's real workload. The idea was to do offline testing with the sy
62.
by apavlo 3y ago
It should be `item.added_rev_id = 3`. I fixed the typo. Not sure how it got mangled. Thanks!
63.
by apavlo 3y ago
> disregarding Recommended Music for this Paper: Dr. Dre – High Powered (featuring RBX)) Why? > that paper seems too short to adequately explore the topic. The paper was published in CIDR ( https://www.cidrdb.org ). The pape
64.
by apavlo 3y ago
Is the list not showing up for you? Can you email me a screenshot: pavlo@ottertune.com It should look like this: https://i.imgur.com/abB2NJX.png
65.
by apavlo 3y ago
OtterTune | REMOTE | Full-time | https://ottertune.com OtterTune is a database optimization-as-a-service company based on research out of Carnegie Mellon University. We use ML to automatically improve the performance of MySQL&#x
66.
by apavlo 3y ago
> Of course at the end of the article they offer a solution - their product (and of course it’s AI enhanced) We have been working on automatic database optimization using AI/ML for a decade at Carnegie Mellon University [1][2]. This
67.
by apavlo 3y ago
No. It would be a major surgery on the internals. See the article for my comment at the attempt to do this with the Zheap project: https://wiki.postgresql.org/wiki/Zheap
68.
by apavlo 3y ago
Legacy reasons. The idea was that you wouldn't need a WAL because the table itself is the log. And then you could support time-travel queries if you never cleaned up the expired tuples.
69.
by apavlo 4y ago
It's one of those things where you know it when you see it. I got 18 year old CMU students showing up knowing how write x86 SIMD intrinsics or ones with LLVM JIT experience. Dirty.
70.
by apavlo 4y ago
Not for the Advanced class. We cover state-of-the-art systems. Textbooks are about 10 years behind.
71.
by apavlo 4y ago
That class just uses my slides. It says so at the bottom of the page: > The lecture slides used in the course are taken from Prof. Andy Pavlo's CMU 15-721 course Just go to the source: https://15721.courses.cs.cmu.edu&#x2
72.
by apavlo 4y ago
OtterTune | REMOTE | Full-time | https://ottertune.com OtterTune is a database optimization-as-a-service company based on research out of Carnegie Mellon University. We use ML to automatically improve the performance of MySQL&#x
73.
by apavlo 4y ago
> The primary con of academia is almost certainly having to live far from family. It depends on your family.
74.
by apavlo 4y ago
> The man writes small databases for fun over a weekend, I mean, come on. I am a student of Mike. He is a great man, but he would not call himself a programmer.
75.
by apavlo 4y ago
I spent some time looking at public documentation and FAA job listings to try to find out what DBMS they are using for NOTAM. I couldn't find anything other than some CFPs about them using Oracle and Sybase.
76.
by apavlo 4y ago
> but maybe what results is a relational database+ type thingy This is called already called "object-relational" model. It was invented by Postgres in the 1980s. The relational model / SQL absorbs the best part of alternat
77.
by apavlo 4y ago
You don't need to be a student to access Gradescope: https://15445.courses.cs.cmu.edu/fall2022/faq.html#q7
78.
by apavlo 4y ago
It's maintained by me (also the author of this article).
79.
by apavlo 4y ago
We want to write a paper on the vast extensions ecosystem for Postgres at some point. It's on my TODO list for 2023. Having so many plug-ins/add-ons available is unique to Postgres and due to Stonebraker's original vision of
80.
by apavlo 4y ago
I saw your engine a week or so ago. Good stuff. I wanted to add it to dbdb.io but I couldn't find an SVG version of this: https://github.com/marsupialtail/quokka/blob/master/docs/doc... Can you
81.
by apavlo 4y ago
> But Musk got started by confounding x.com/PayPal, which does have very similar engineering needs as Twitter. But PayPal was running Oracle on IBM bigiron machines even after Musk left them.
82.
by apavlo 4y ago
This is pretty much how all DBMSs work right now. You have to tell it how much memory it can use for its internal buffer pool.
83.
by apavlo 4y ago
I taught Judy Arrays in our Advanced DB course in 2020: https://youtu.be/N6rhECUjdaI?t=3043 AFAIK nobody uses them because of the (unfounded) patent fears. ART indexes are a modern implementation of radix trees / tries
84.
Fixing Slow PostgreSQL Queries: How to Make a Smart Optimizer More Stupid(ottertune.com)
13 points by apavlo 4y ago|0 comments
85.
by apavlo 4y ago
> How can someone get started writing a database these days? Take my class. It starts next week: https://15445.courses.cs.cmu.edu/fall2022/
86.
by apavlo 4y ago
Why would you link to an interview with unknown developers instead of a Github repo or something that describes the system architecture? AFAIK MorselsDB is a closed-source fork of Clickhouse and the only info about it are these interviews.
87.
by apavlo 4y ago
Everyone should watch one of Martin's last public talks in 2021 on Youtube: MonetDB: Scale Up Before You Scale Out https://youtu.be/vjWRE0UnJDQ https://db.cs.cmu.edu/events/vaccination-2021-monetdb
88.
by apavlo 4y ago
But it's just a wrapper around SQLite. Skip the middleman and just use SQLite.
89.
by apavlo 4y ago
Postgres is not every system. Just because it requires manually refreshing matviews doesn't mean that every DBMS works that way. Seriously, read a textbook: http://db.cs.duke.edu/papers/fntdb12-ChirkovaYang-mat_vie
90.
by apavlo 4y ago
From the documentation: > Yet SQL does not provide a way of indexing queries that involve a JOIN. Social apps that want to query "what are all the posts of all the people I follow ordered in time" must design their own systems

More ›