3 ms·
This feels like https://ballerina.io/ https://ballerina.io/ but for non-programmers, and with SaaS integrations built-in. I've spent so much time moving CSV bet
by adamfeldman 8y ago
This feels like https://ballerina.io/ https://ballerina.io/ but for non-programmers, and with SaaS integrations built-in. I've spent so much time moving CSV between systems at an ecommerce company.
Congrats on the launch, this looks awesome! Would love to learn more about how it was built.
- cbkirk 8y agoThanks @adamfeldman. Parabola originally was pure JS: running the majority of each step function of the language in the user’s browser, making use of some python API endpoints and React and Immutable.js for some performance enhancements to know when steps needed to be calculated and rendered. Given there are definite limitations with browser based JS and user’s systems, we’re now a fully cloud based compute environment. As users make changes in our React UI, we send the work to a queue and then distribute it by parsing the flow tree across various node worker servers so steps can run in parallel (if your flow is built that way). Each step is self contained and we then use sockets (powered by PubNub) to notify the UI of changes.
- markatkinson 8y agoCan I ask what cloud products you use and the provider? Azure, AWS GC?
- toomuchtodo 8y agoThis is a great way to scale your system. Well done. AWS Lambda is fairly reliable for running untrusted functions (as well as trusted functions with carefully managed inputs) at scale for customers, but any function provider should work well for this purpose (as long as their container lifecycle meets your needs).
- rpadude 8y agoVery cool. Similar to https://airflow.apache.org https://airflow.apache.org https://Composable.ai https://Composable.ai ...