followtherhythm

6 ms·

1.
by followtherhythm 5y ago
Hi, of course there are :) So the transformations are deployed in a separate NodeJs process per node. You can use familiar tools to take a look at its cpu + memory usage. As for how it affects redpanda, currently we are working on exposing
2.
by followtherhythm 5y ago
Currently they cannot, as they share all of the same properties as their respective source topics, but this idea is good! I'm adding it to our list of design enhancements.
3.
by followtherhythm 5y ago
Good question! You can't re-key your records but this done is by design. We want the materialized partitions to reside on the same brokers as their sources so there is no network overhead for performing the transform, and it occurs on
4.
by followtherhythm 5y ago
We see a lot of demand for onboard transformations, and JS is our first trial, since most devs are familiar with it. We plan to look into Rust and all of the Wasm supported languages, based on user demand
5.
by followtherhythm 5y ago
Yup, as of now we are leveraging Nodejs for the technical preview. We also have another preview using embedded v8 for inline transforms, that is your transform runs in-process and apply() boils down to a function call. We are still evaluati
6.
by followtherhythm 5y ago
Hi I'm one of the authors of the blog post, happy to answer any questions here !
7.
by followtherhythm 6y ago
This is so dope, I am trying it out asap!
8.
by followtherhythm 6y ago
Redpanda https://vectorized.io/
9.
Concord Claims 10x Performance Edge on Spark Streaming(datanami.com)
9 points by followtherhythm 10y ago|1 comments
10.
Getting Concord on the DC/OS Universe(concord.io)
3 points by followtherhythm 10y ago|0 comments
11.
by followtherhythm 10y ago
Yes Storm is still under active development. Yahoo, Baidu and other big players continue to use Storm. To be honest Storm's API is richer. Our approach however was to make stream processing available to all developers. It doesn't
12.
by followtherhythm 10y ago
Since Mesos uses Zookeeper and we are tightly bound to Mesos, at the moment this is not possible.
13.
by followtherhythm 10y ago
If by 'input/output' sources, you mean computations that will pull or push from an external system such as kafka/cassandra, there isn't any documentation currently. However we have written connectors to Kafka and Ki
14.
by followtherhythm 10y ago
There are a lot of reasons why, probably enough to write a blog post about. To summarize I would say that this is mainly a byproduct of being close to the metal, and our use of lock free code on the fast path. Also our system is relatively
15.
by followtherhythm 10y ago
Hello, I am a software engineer at Concord. Happy to answer anyones questions