4 ms·

Interesting project! I only got to know about Apache Calcite a few months/weeks ago, but it seems like it's becoming a de facto way of supporting SQL on analyti

Interesting project! I only got to know about Apache Calcite a few months/weeks ago, but it seems like it's becoming a de facto way of supporting SQL on analytics products. I can think of Dremio [1] as an example. From an implementation perspective, I wonder how AthenaX will compare to the Apache Beam SQL DSL [2] (I haven't tried it out, still learning DoFn, ParDo, etc.). Beam is also leveraging Calcite, with the partial difference that it runs* on Flink amongst others. I think it's safe to say that the streaming analytics ecosystem remains interesting and exciting! Hope I'll be able to try out AthenaX, congratulations on the release. [1] https://www.dremio.com https://www.dremio.com [2] https://github.com/apache/beam/tree/DSL_SQL https://github.com/apache/beam/tree/DSL_SQL

haohui 9y ago
I'm not fully familiar with Apache Beam SQL DSL so I can't really provide anything insightful. But yes streaming analytics is a very exciting area. Your feedbacks are appreciated.
- nevi-me 9y ago
  I think it'll only be released in the next minor version. We currently need to build from source to try it, so I'm waiting for next version. I'm still learning the Java API, which is a lot for a few hours here and there. In the blog post, you talk about running AthX on YARN, so am I correct in saying that I might not be able to run it on single-machine mode? I'd like to try it out (SQL window functions are easier to understand than Beam Java ones). Maybe Gitter or a public Slack channel could help, more users will have queries that aren't suitable for HN nor GitHub issues.
  - haohui 9y ago
    You can definitely start a single node Flink-on-YARN cluster. That's how all the integration tests are set up. What do you think of posting the questions on the mailing list [1]? [1] https://groups.google.com/forum/#!forum/athenax-users https://groups.google.com/forum/#!forum/athenax-users

haohui 9y ago

I'm not fully familiar with Apache Beam SQL DSL so I can't really provide anything insightful. But yes streaming analytics is a very exciting area. Your feedbacks are appreciated.

nevi-me 9y ago
I think it'll only be released in the next minor version. We currently need to build from source to try it, so I'm waiting for next version. I'm still learning the Java API, which is a lot for a few hours here and there. In the blog post, you talk about running AthX on YARN, so am I correct in saying that I might not be able to run it on single-machine mode? I'd like to try it out (SQL window functions are easier to understand than Beam Java ones). Maybe Gitter or a public Slack channel could help, more users will have queries that aren't suitable for HN nor GitHub issues.
- haohui 9y ago
  You can definitely start a single node Flink-on-YARN cluster. That's how all the integration tests are set up. What do you think of posting the questions on the mailing list [1]? [1] https://groups.google.com/forum/#!forum/athenax-users https://groups.google.com/forum/#!forum/athenax-users