XPherior

10 ms·

1.
What keeps Apache Kafka from eating the world?(medium.com)
2 points by XPherior 8y ago|3 comments
2.
Streamlining event data infrastructure(pyroclast.io)
1 points by XPherior 9y ago|0 comments
3.
A low-tech primer on event data for your boss(pyroclast.io)
3 points by XPherior 9y ago|0 comments
4.
Complex event processing in Clojure and ClojureScript(pyroclast.io)
3 points by XPherior 9y ago|0 comments
5.
by XPherior 9y ago
One of the authors here. The neat thing about this set up is that these streaming examples are executing against a real stream processor in the browser. The interactive examples were built using [Onyx]( https://github.com/ony
6.
Turn plain Clojure code into streaming microservices(pyroclast.io)
1 points by XPherior 9y ago|0 comments
7.
Rapidly connecting realtime event streaming to programming languages(pyroclast.io)
3 points by XPherior 9y ago|0 comments
8.
Challenges of Record Replay in Event Streaming Architectures(pyroclast.io)
6 points by XPherior 9y ago|0 comments
9.
The Future of Event Stream Processing(pyroclast.io)
13 points by XPherior 9y ago|0 comments
10.
by XPherior 9y ago
Distributed Masonry uses Clojure to build Onyx [1], an open source distributed batch and streaming platform. We also build a realtime application platform named Pyroclast [2] directly on top of Onyx. Our code base is written entirely in Clo
11.
Simulate Big Data Computations in the Browser(onyxplatform.org)
8 points by XPherior 10y ago|0 comments
12.
Onyx: High Performance Cluster Computation for Clojure(onyxplatform.org)
6 points by XPherior 11y ago|0 comments
13.
Onyx: High Performance, Distributed Batch and Stream Processing(onyxplatform.org)
7 points by XPherior 11y ago|0 comments
14.
Onyx: Flexible Stream Processing for the JVM(onyxplatform.org)
4 points by XPherior 11y ago|0 comments
15.
Clojure Conj 2015: Onyx – Distributed Computing in Clojure(youtube.com)
2 points by XPherior 11y ago|0 comments
16.
by XPherior 11y ago
We persist the IDs to disk with RocksDB itself when that happens, periodically pruning them away when the messages are complete. The Bloom filter is mostly an optimization - even though it does the job most of the time. You're right -
17.
Onyx 0.7.0: High Performance Cluster Computing in Clojure(michaeldrogalis.github.io)
21 points by XPherior 11y ago|0 comments
18.
Onyx 0.6.0: Going Faster(michaeldrogalis.github.io)
142 points by XPherior 11y ago|13 comments
19.
by XPherior 12y ago
Performance - wait until the 0.6.0 release. We'll be caught up with Storm by then. The tree model is being removed in 0.6.0 in favor of a vector of vectors (DAG), which allows multiple inputs. See https://github.com/Mic
20.
by XPherior 12y ago
I wasn't aware that they're Thrift serializable - that's cool, and offers roughly what Onyx does in terms of its workflow representation. Onyx goes a little further though in terms of its catalog. I wanted more of the computa
21.
by XPherior 12y ago
- Picking up Kafka means introducing another dependency. - Onyx's log doesn't grow particularly large because it's only used for coordination, not for messaging. - Because the log isn't huge, and can be GC'ed, consu
22.
by XPherior 12y ago
I'll paraphrase a few snippets from my own documentation to answer these questions. Happy to comment more if needed. Information models are often superior to APIs, and almost always better than DSLs. The hyper-flexibility of a data str
23.
by XPherior 12y ago
See: https://github.com/MichaelDrogalis/onyx/blob/0.5.x/doc/user-... These are all the things I wrote down that I wanted before I wrote the first line of code.
24.
by XPherior 12y ago
Hi folks! I'm Michael Drogalis - the primary author. I'm happy to answer any questions.
25.
by XPherior 12y ago
Hello, Michael Drogalis - the author here. I'm also not a Spark user, but I have used Storm: - Storm is significantly more mature and performant the moment. - Storm has a better cross-language story in terms of bolt functions. - Pretty
26.
Onyx 0.5.0: The Cluster as a Value(michaeldrogalis.github.io)
11 points by XPherior 12y ago|0 comments
27.
Onyx 0.4.0: DAG workflows, catalog grouping, lib-onyx(michaeldrogalis.tumblr.com)
2 points by XPherior 12y ago|0 comments
28.
by XPherior 12y ago
Thank you. :)
29.
by XPherior 12y ago
I'm not sure if exactly-once messaging is possible in a distributed system. Onyx gets close in that it uses transactions to move data across queues atomically. But code can fail just before a transaction is committed. The transaction
30.
by XPherior 12y ago
Hello! Michael Drogalis, the developer, here. I talked a little bit about why I wrote Onyx on the Clojure mailing list: https://groups.google.com/d/msg/clojure/OmHzAEfYe9U/33e0a0l3... It's mostly dr

More ›