3 ms·
How does this compare to cask hydrator/cdap? What does the migration from R or python ETLs to this resemble?
by tgtweak 7y ago
How does this compare to cask hydrator/cdap? What does the migration from R or python ETLs to this resemble?
- ibains 7y agoWe're not adding a layer on top of all big data platforms, instead we work on Spark directly. This has advantages, disadvantages. When you use our product, your code looks very similar to writing Spark code in IntelliJ. You get visual workflows along with it. Our users are not having to learn or use another layer of abstractions that locks them into our API, and we avoid performance Apart from interface, we automatically "convert" your legacy code into Spark & "migrate" these Spark workflows from one cluster to another. You can move workflows from private cloud to public cloud, or to another datacenter.
- tgtweak 7y agoWhat about existing spark/scala workflows? Can they be imported?