3 ms·

I build a somewhat similar app, DataStation [0], that is in JavaScript and Go. It supports scripting in Python, Julia, R, JavaScript, Ruby, etc. The server ver

I build a somewhat similar app, DataStation [0], that is in JavaScript and Go. It supports scripting in Python, Julia, R, JavaScript, Ruby, etc. The server version of it exists and I run it myself but that process is not documented yet. (Most people use it as a desktop app today.) [0] https://github.com/multiprocessio/datastation https://github.com/multiprocessio/datastation

anyfactor 5y ago
This is very interesting. I was actually looking for a cleaner way to write SQL and Python code. I find writing multistring SQL query on Python code messy so looking forward to giving DataStation a shot. Couple of question- - Are you building this as a pure Open Source project? I couldn't find the pricing section, and you have built it as an electron project. I am curious to know about your pricing strategy. - Have you considered incorporating dbt or dbt like syntax query?
- eatonphil 5y ago
  > - Are you building this as a pure Open Source project? I couldn't find the pricing section, and you have built it as an electron project. I am curious to know about your pricing strategy. Long-term plan is that everything currently open source will always be open source (and there's quite a lot I believe). I'd like to release a hosted (paid) SaaS version for teams and an enterprise version also aimed at teams. But the desktop app that exists now will always be free and open source. And I have no plans to stop adding new databases, file sources, and scripting languages as needed to the open source core. > Have you considered incorporating dbt or dbt like syntax query? I think it's already pretty close to this. You can import data within SQL queries (works with SQLite, MySQL, and PostgreSQL) using the `DM_getPanel` syntax. For everything else you can use Jinja-style templates [0]. This allows you to, for example, run a query to select IDs based on some filter in a PostgreSQL database and then pass those IDs to an Elasticsearch filter in another panel -- without writing any code. [0] https://datastation.multiprocess.io/docs/latest/Panels/Macros.html https://datastation.multiprocess.io/docs/latest/Panels/Macro...
  - anyfactor 5y ago
    Thank you for responding. You have built something incredible. Also, I really like how you have incorporated gifs in the documentation. Wishing you all the best luck!
    - eatonphil 5y ago
      Thank you! It's still early stages of course. Always grateful for any feedback if you ever have any; feel free to share on discord or email me.

anyfactor 5y ago

This is very interesting. I was actually looking for a cleaner way to write SQL and Python code. I find writing multistring SQL query on Python code messy so looking forward to giving DataStation a shot. Couple of question- - Are you building this as a pure Open Source project? I couldn't find the pricing section, and you have built it as an electron project. I am curious to know about your pricing strategy. - Have you considered incorporating dbt or dbt like syntax query?

eatonphil 5y ago
> - Are you building this as a pure Open Source project? I couldn't find the pricing section, and you have built it as an electron project. I am curious to know about your pricing strategy. Long-term plan is that everything currently open source will always be open source (and there's quite a lot I believe). I'd like to release a hosted (paid) SaaS version for teams and an enterprise version also aimed at teams. But the desktop app that exists now will always be free and open source. And I have no plans to stop adding new databases, file sources, and scripting languages as needed to the open source core. > Have you considered incorporating dbt or dbt like syntax query? I think it's already pretty close to this. You can import data within SQL queries (works with SQLite, MySQL, and PostgreSQL) using the `DM_getPanel` syntax. For everything else you can use Jinja-style templates [0]. This allows you to, for example, run a query to select IDs based on some filter in a PostgreSQL database and then pass those IDs to an Elasticsearch filter in another panel -- without writing any code. [0] https://datastation.multiprocess.io/docs/latest/Panels/Macros.html https://datastation.multiprocess.io/docs/latest/Panels/Macro...
- anyfactor 5y ago
  Thank you for responding. You have built something incredible. Also, I really like how you have incorporated gifs in the documentation. Wishing you all the best luck!
  - eatonphil 5y ago
    Thank you! It's still early stages of course. Always grateful for any feedback if you ever have any; feel free to share on discord or email me.