4 ms·
Having come from Julia - I rather like elixir. Rust seems like it's great if you need control over everthing at a low level (great for browsers, operating syst
by dnautics 8y ago
Having come from Julia - I rather like elixir. Rust seems like it's great if you need control over everthing at a low level (great for browsers, operating systems). If you want a high level, but still very performant[0], FP language with very nice guardrails... I wrote a complete scheduler for data science tasks, from nothing, in 3 months.
[0] a lot of people seem to think that performance is everything but actually uptime and reliability are often more important.
- shele 8y agoI came the other way around and tried some Erlang before settling on Julia, but if I your focus is on scheduling of data science tasks I know why you used elixir.
- cercatrova 8y agoWith Elixir, can I set up a queue of separate programs written in other languages (Python/TensorFlow) such that when one task is finished, another can be started right away, or have a programmatic schedule? Essentially, can Elixir act as the scheduler for various tasks, or even spin up AWS instances through its scheduling?
- shele 8y agoYou should ask the poster above me.
- cercatrova 8y agoIndeed I shall
- dnautics 8y agoyou definitely don't want to be using a BEAM language for numeric computation. On the other hand, if you try to write a web application in Julia, you have no uptime guarantees. I think that Elixir/Julia would make a really sweet combination for certain things, if Julia could easily talk to BEAM instances by presenting itself as BEAM node (to do RPCs from Elixir to Julia).
- shele 8y agoYeah, I can imagine. That would maybe also not be too difficult as Julia apparently could ccall the erl_interface c-library http://erlang.org/doc/apps/erl_interface/ei_users_guide.html http://erlang.org/doc/apps/erl_interface/ei_users_guide.html
- deleted 8y ago[deleted]
- microcolonel 8y agoElixir's straight-line performance is horrible though, and the available profiling tools are not adequate to solve performance issues in anything that runs more than a few hundred milliseconds. Last year I had to buy a workstation with 64GiB of RAM because my team didn't have time to write a new profiler (or somehow fix the existing one), and all the current ones filled RAM almost as fast as memcpy, and one hit/request was taking ~400ms (without profiling overhead).
- cercatrova 8y agoWith Elixir, can I set up a queue of separate programs written in other languages (Python/TensorFlow) such that when one task is finished, another can be started right away, or have a programmatic schedule? Essentially, can Elixir act as the scheduler for various tasks, or even spin up AWS instances through its scheduling?
- dnautics 8y agonot out of the box, but that's basically what I wrote.
- cercatrova 8y agoHow does one connect Elixir to the various other programs? I'm not too familiar with it, just curious.
- dnautics 8y agoI use singularity containers! So that lets me define and use a "unified shell out" protocol. It's pretty sweet. If you have any questions drop a line.