lbradstreet

6 ms·

1.
Property Based Testing Confluent Server Storage for Fun and Safety(confluent.io)
7 points by lbradstreet 6y ago|0 comments
2.
by lbradstreet 8y ago
I'd like to stress the point in the article about how important the . is to efficient vim use. https://pragprog.com/book/dnvim2/practical-vim-second-editio... completely changed how I use vi in this respect.
3.
by lbradstreet 8y ago
It's not that I wouldn't recommend it, I would just think twice recommending it for very small ops teams for certain use cases. It's not so hard to manage, but having it be managed by Confluent is a great option.
4.
by lbradstreet 8y ago
I love Kafka and the log orientated streaming model, but I often have to think twice before recommending it to clients who would have to manage the ops themselves. Having a managed service on GCP, and Confluent's existing cloud offerin
5.
by lbradstreet 8y ago
Yes, I like to think of it as as the transaction log without any of the logic. If you’re interested, I can highly recommend Martin Kleppmann’s talk “Turning the database inside out” https://www.youtube.com/watch?v=fU9hR3kiOK
6.
by lbradstreet 8y ago
PubSub is fundamentally a different abstraction than Kafka which is log orientated. With Kafka you can maintain the ability to replay your log/stream, in order, at any time. This enables different kinds of use cases, and can be easier
7.
Hyperpartitioning Apache Kafka: Embracing Conway’s Law with Pyrostore(pyrostore.io)
12 points by lbradstreet 8y ago|1 comments
8.
by lbradstreet 8y ago
Our approach archives topics to cheap, highly durable and available object stores, while keeping the data available for blending between warehoused and live data sets. This reduces operational complexity significantly vs scaling nodes up, d
9.
by lbradstreet 8y ago
We will be launching support for native excision and data anonymization soon, as these are extremely important to storing streaming data for the long term. Workarounds for excision in Kafka, such as key compaction, are often not possible to
10.
by lbradstreet 8y ago
As a side note, we provide tooling to maintain Amazon Athena/Hive,Presto support over your Pyrostore archived data in S3, while maintaining its ability to be streamed in-order.
11.
by lbradstreet 8y ago
Pyrostore co-founder here. When practitioners archive their data from Kafka to other storage products (S3, SQL database, etc) today, they are giving up on the log ordered structure of the data their ability to consume their data in its orig
12.
Commanding infinite streaming storage with Apache Kafka and Pyrostore(pyrostore.io)
68 points by lbradstreet 8y ago|27 comments
13.
by lbradstreet 9y ago
On the face of it, the lender has no more incentive, but having an unforgeable trail of ownership and payment may improve the value of the loan as it passes from hand to hand. That all said, a blockchain is not really required. Better stand
14.
by lbradstreet 9y ago
You still need to be able to transfer the loan from party to party, and allow parties to prove ownership of the loan. That's not a complex contract obviously, but it's important.
15.
by lbradstreet 9y ago
I'm not a huge proponent on smart contracts, and I agree that it's a big problem enforcing payback, but that's no worse than regular loans. At least the ownership/transfership and payback of loans could be tracked, which
16.
Event streaming over session windows: an interactive guide(pyroclast.io)
14 points by lbradstreet 9y ago|2 comments
17.
by lbradstreet 9y ago
If that's true, third party middlemen with quantum devices could work around this until it becomes more mainstream. At least it would allow it to not wither on the vine until everything is restructured. It's not really obvious wha
18.
by lbradstreet 10y ago
You can trade odd lots pretty cheaply these days.
19.
by lbradstreet 10y ago
I wholeheartedly approve of the new licensing. The previous licensing was incredibly restrictive for microservices and for scaling out reads in an elastic way. The new model is much easier to understand and use in the ways that datomic was
20.
by lbradstreet 10y ago
Especially this financial magic "The deal also promises to help CenturyLink by giving it access to about $10 billion in tax credits that Level 3 is carrying on its books"
21.
by lbradstreet 10y ago
A fantastic library. We switched Onyx Platform www.onyxplatform.org over to it from Netty, and it was a lot easier to write than the netty messaging layer that we had, which required a lot of tuning and thought to get right. I learned a l
22.
by lbradstreet 10y ago
It's striking how many of these issues cause panics because of assertions that were already in the code. Without good assertion use, I would assume that many of these would have been much worse.
23.
by lbradstreet 10y ago
Even the top of the line Mac Pro is not good enough. I've used it with the DK2 in Windows, and judder was still a huge problem.
24.
by lbradstreet 10y ago
The repo was updated 13 days ago.
25.
by lbradstreet 11y ago
Interesting. That's a bit counter intuitive - thanks for the counter argument.
26.
by lbradstreet 11y ago
One theory is that electric cars look distinctively ugly because their owners want them to stand out as an eco friendly car. The Prius tail is an example of this. I think that it limits how mass market you can go, however it seemed to work
27.
by lbradstreet 11y ago
It was a lot of fun testing Onyx using Jepsen, though it did take some time to get things right. If anyone has questions about testing a distributed system in this way I'd be happy to answer them.
28.
Onyx Straps in For a Jepsening(onyxplatform.org)
44 points by lbradstreet 11y ago|5 comments
29.
by lbradstreet 11y ago
Just a side note. After some benchmarking, I recently discovered that c3.2xlarge does not actually have 8 cores, rather it had 4 real cores = 8 hyper threaded cores. I was very surprised by this and suspect most other AWS users would also b
30.
by lbradstreet 11y ago
I'm one of the lead developers of Onyx, if anyone has any questions they'd like answered.

More ›