haohui

7 ms·

1.
by haohui 9y ago
(1) Yes. AthenaX provides a thin wrapper of KafkaJsonTableSource[1] out-of-the-box. As long as you specify the schema it should be good to go. (2) Your guess is correct. Internally we have AthenaX streaming data to MemSQL, Pinot or MySQL to
2.
by haohui 9y ago
For UDF we support both -- users can write their own UDFs in their queries. We provide a number of well-tested UDFs to them as well.
3.
by haohui 9y ago
TPC-DS evaluates against batch processing and it is great to hear that Spark supports all of them. I think the space for streaming processing is still quickly evolving. Many features like stream-table joins, CTEs, streaming joins with late
4.
by haohui 9y ago
Our experience is that AthenaX actually lowers our support costs: (1) There are significant loads on consultations when users had to implement their own jobs in Java / Scala and run them in production. Sometimes it turned in to co-deve
5.
by haohui 9y ago
It would reduce the latency of data but we have not tried in production. Given that Kafka neither provides secondary indexes nor organizes data in columnar format, Presto essentially have to somewhat scan through the Kafka topics to execute
6.
by haohui 9y ago
You can definitely start a single node Flink-on-YARN cluster. That's how all the integration tests are set up. What do you think of posting the questions on the mailing list [1]? [1] https://groups.google.com/forum&#x2F
7.
by haohui 9y ago
Unfortunately the UI did not make it to the first version of the open-source release. It's low priority given the fact that the UI itself usually heavily tied to the business needs. We internally have a React-based UI and we are in the
8.
by haohui 9y ago
I'm not fully familiar with Apache Beam SQL DSL so I can't really provide anything insightful. But yes streaming analytics is a very exciting area. Your feedbacks are appreciated.
9.
by haohui 9y ago
Agree :-) Proposals on names are always welcomed.
10.
by haohui 9y ago
It is great to see that SQL becomes one of the de facto standards of building streaming analytics applications. Personally I'm not a big fan of KSQL, given that: (1) KSQL is built on top of Kafka Stream. There are use cases that we don
11.
by haohui 9y ago
Hello, Haohui here. I'm one of the developer of AthenaX. I'm really glad that the project attracts so many interests. Before AthenaX most of our real-time analytic pipelines were on Samza, which to to some extent can be seen as pr