mslot

12 ms·

91.
by mslot 9y ago
In general I'd expect native partitioning to have similar performance characteristics as TimescaleDB. On the insert side lot of the benefit comes from partitions having small indexes, on the delete side from the ability to drop partiti
92.
by mslot 9y ago
The Citus Cloud service is similar to RDS, but for Citus clusters. Every cluster runs on AWS in its own VPC and it lets you peer with the VPC. It also provides auto-failover, PITR, forking, read-only followers and scaling out without any do
93.
by mslot 9y ago
Big shout-out to Keith Fiske for developing and maintaining pg_partman. It makes Postgres 10's native partitioning really easy to use.
94.
by mslot 9y ago
> Aren't high contention and deadlocking workloads essentially the same thing to a deadlock-detection db? High contention means that there are many concurrent transactions modifying the same rows. Deadlocking means transactions mod
95.
by mslot 9y ago
Not practically, except when it is a single-statement transaction. Where deadlock prevention becomes useful/necessary is single UPDATE/DELETE statements that span across multiple nodes. When those are executed in parallel they cou
96.
by mslot 9y ago
> Am I overestimating the cost of deadlock detection? I think you might have them backwards. Deadlock avoidance becomes costly at high contention workloads (due to aggressive locks, retry loops). Deadlock detection only becomes costly at
97.
by mslot 9y ago
> But what about commits that are not acked? For example, is it possible for the master to apply a commit which is then seen by another query (from another client), then crash before the commit is sent to the slave? A commit doesn't
98.
by mslot 9y ago
> the fact that a deal with IBM meant they had "won it" The IBM deal meant that DOS was going to be the Operating System for IBM's Personal Computer and became the de facto OS for all IBM PC clones. That was the deal that
99.
by mslot 9y ago
It's always about trade-offs. Citus has ACID transactions within nodes, and ACD transactions across nodes. It does not have distributed snapshot isolation, but that means it also avoids the latency and concurrency penalties that come w
100.
by mslot 9y ago
There's a postgres operator by Zalando which sets up postgres with WAL-E and auto failover using Patroni. https://github.com/zalando-incubator/postgres-operator
101.
by mslot 9y ago
> Secondaries cover this case for Gitlab, it seems, but that comes with a set of caveats as well (namely async availability of data). Another caveat is that all secondaries will end up having more or less the same stuff in their cache. A
102.
by mslot 9y ago
> Would it be feasible to make Podyn run in a scheduled Lambda function? would save us from having an EC2 around... That's an interesting idea! My mental model for running Podyn was a container or T2 instance, but I think it wouldn&
103.
by mslot 9y ago
Author here. I'm interested in learning a little more about DynamoDB "schemas" in the wild. For DynamoDB users: Is translating the top-level keys in items into columns a reasonable thing to do? (schema conversion rules: http
104.
by mslot 9y ago
Author here. This is a pretty new tool. If you have any thoughts on how to best translate a DynamoDB schema to postgres or other feature ideas, I'd love to hear! Github page: https://github.com/citusdata/podyn
105.
by mslot 9y ago
We don't have TPC-C numbers. I did run some pgbench numbers and put together a little video comparing Citus to Postgres: https://s3.amazonaws.com/citus-conferences/postgresopen-keyn... (no audio)
106.
by mslot 9y ago
Consider UPDATEs that depend on each other: UPDATE table SET value = value + 2 WHERE key = 'world'; UPDATE table SET value = value * 1.1 WHERE key = 'world'; When these UPDATEs are executed concurrently, Pos
107.
by mslot 9y ago
Author here. For the purpose of the article, adding a user ID column to the items table primarily helps with distributing the data, since all of a user's lists and items can be placed on the same node based on the value in the user ID
108.
by mslot 9y ago
Biased view of a Citus engineer here :) Any enhancement to PostgreSQL is also an enhancement to Citus, or rather, the PostgreSQL ecosystem as a whole. For example, PostgreSQL 10's declarative partitioning feature will help enable shard
109.
by mslot 10y ago
> Citus deployed in a cloud is a bit sensitive. As the master node keeps track of each worker in almost realtime fashion, any breaks in communication results in corrupted shards. If you don't use just one user (postgres) but have d
110.
by mslot 10y ago
Isn't the opposite true, though? SQL offers you a lot of flexibility, whereas NoSQL follows a rigid data model.
111.
by mslot 10y ago
I always think there are huge opportunities for growth in intra-EU trade. It's a market with over 500M people and a $17 trillion GDP. While the EU has taken away a lot of trade barriers, language and unfamiliar regulations remain a hug
112.
by mslot 10y ago
(Marco from Citus Data) It depends on the use-case, but PostgreSQL and Citus can be a sensible alternative to NoSQL. RDBMS and NoSQL are on the opposite ends of the scaling spectrum. RDMBS provide very rich functionality and put few restric
113.
by mslot 10y ago
Don't worry ;) Citus users typically have a working set of a few hundred GB or more and run into memory and CPU limitations on a single machine on both the write and the read side. Provided your data has a natural sharding dimension (e
114.
by mslot 10y ago
(Marco from Citus Data) Pre-aggregation is less common in data warehouses use-cases than it is in real-time use-cases. Data warehouses are generally used by a small number of users that run ad-hoc reporting queries and can take anywhere fro
115.
by mslot 10y ago
The "modern left" is not some kind of hive mind to which we all belong. It's a very diverse contingent of society, that cannot simply be compared to rural America. Clearly, if you are an uneducated white man from a small vill
116.
by mslot 10y ago
Was going to say, RX100 is in a class of its own :). I always have it with me when I travel and often have it my pocket just in case. I don't always use it, but it's small enough not to care. Especially for outdoors photography, a
117.
by mslot 10y ago
I think it's pretty clearly specified which ones are apartments. I travel very frequently and have had various bad experiences with AirBnB. Nowadays I almost always book an apartment via booking.com. It's nice to have an actual cu
118.
by mslot 10y ago
Or rather, an almost instant traffic fine between $100 and $400.
119.
by mslot 10y ago
I wonder if the 2 cameras can be used as a stereo camera for augmented reality.
120.
by mslot 10y ago
Well, we can buy mozzarella that's actually mozzarella, so that's something.

More ›