4 ms·

I don't think many people know how amazing Elixir has become at machine learning. If you want to learn more I can't recommend Seam Moriarity's book Machine Lear

I don't think many people know how amazing Elixir has become at machine learning. If you want to learn more I can't recommend Seam Moriarity's book Machine Learning in Elixir enough. Concepts are explained in extremely straight forward language and there's loads of examples! https://pragprog.com/titles/smelixir/machine-learning-in-elixir/ https://pragprog.com/titles/smelixir/machine-learning-in-eli...

jatins 3y ago
Does Elixir ML ecosystem libs (Nx, Axon) provide some sort of interop with Python ecosystem? For example can I load or fine tune a model pre-trained in pytorch/JAX in Axon? Or does everything need to be written from ground up in Elixir?
- ricketycricket 3y ago
  Ortex exists to run ONNX models: https://github.com/elixir-nx/ortex https://github.com/elixir-nx/ortex
- ac_alejos 3y ago
  Not directly but it supports the ONNX Runtime and has support for many of the models you might want through Bumblebee and Hugging Face https://github.com/elixir-nx/bumblebee https://github.com/elixir-nx/bumblebee
  - thibaut_barrere 3y ago
    (sorry for the double post!)
- thibaut_barrere 3y ago
  Despite some limitations, you will probably find Bumblebee (https://github.com/elixir-nx/bumblebee https://github.com/elixir-nx/bumblebee) interesting. "Bumblebee provides pre-trained Neural Network models on top of Axon. It includes integration with HuggingFace Models, allowing anyone to download and perform Machine Learning tasks with few lines of code"
thibaut_barrere 3y ago
Yes, this is getting quite exciting. There is cross-pollinisation of concepts going on (e.g. https://www.youtube.com/watch?v=RABXu7zqnT0 https://www.youtube.com/watch?v=RABXu7zqnT0 which shows a port of Python's Instructor library to https://github.com/thmsmlr/instructor_ex https://github.com/thmsmlr/instructor_ex, https://hexdocs.pm/scholar/Scholar.html https://hexdocs.pm/scholar/Scholar.html etc!). That coupled with LiveView + (quite easy scaling in general) results into interesting opportunities.
- andy_ppp 3y ago
  The scaling story in Elixir is so nice, I just implemented eventual consistency for calculating average ratings on a Class/Instructor level and it was 20 lines of code in a GenServer that can be tested and is super clear how it works. I'm not even sure how you'd do something like this in Javascript or Python but it would probably involve extra infrastructure that is another moving piece to deploy, manage and can be a cause of potential failures. The same is true with rate limiting and something like Hammer (https://github.com/ExHammer/hammer https://github.com/ExHammer/hammer).
enraged_camel 3y ago
It says the book is in beta. How complete/finished is it?
- seanmor5 3y ago
  Hey, I'm the author! All of the chapters are done, but there are still some minor updates as APIs change. It should be going to production soon
  - enraged_camel 3y ago
    Nice. Just placed an order.
jonvk 3y ago
I'm guessing you mean that you would recommend it. You say you can't.

jatins 3y ago

Does Elixir ML ecosystem libs (Nx, Axon) provide some sort of interop with Python ecosystem? For example can I load or fine tune a model pre-trained in pytorch/JAX in Axon? Or does everything need to be written from ground up in Elixir?

ricketycricket 3y ago
Ortex exists to run ONNX models: https://github.com/elixir-nx/ortex https://github.com/elixir-nx/ortex
ac_alejos 3y ago
Not directly but it supports the ONNX Runtime and has support for many of the models you might want through Bumblebee and Hugging Face https://github.com/elixir-nx/bumblebee https://github.com/elixir-nx/bumblebee
- thibaut_barrere 3y ago
  (sorry for the double post!)
thibaut_barrere 3y ago
Despite some limitations, you will probably find Bumblebee (https://github.com/elixir-nx/bumblebee https://github.com/elixir-nx/bumblebee) interesting. "Bumblebee provides pre-trained Neural Network models on top of Axon. It includes integration with HuggingFace Models, allowing anyone to download and perform Machine Learning tasks with few lines of code"

thibaut_barrere 3y ago

Yes, this is getting quite exciting. There is cross-pollinisation of concepts going on (e.g. https://www.youtube.com/watch?v=RABXu7zqnT0 https://www.youtube.com/watch?v=RABXu7zqnT0 which shows a port of Python's Instructor library to https://github.com/thmsmlr/instructor_ex https://github.com/thmsmlr/instructor_ex, https://hexdocs.pm/scholar/Scholar.html https://hexdocs.pm/scholar/Scholar.html etc!). That coupled with LiveView + (quite easy scaling in general) results into interesting opportunities.

andy_ppp 3y ago
The scaling story in Elixir is so nice, I just implemented eventual consistency for calculating average ratings on a Class/Instructor level and it was 20 lines of code in a GenServer that can be tested and is super clear how it works. I'm not even sure how you'd do something like this in Javascript or Python but it would probably involve extra infrastructure that is another moving piece to deploy, manage and can be a cause of potential failures. The same is true with rate limiting and something like Hammer (https://github.com/ExHammer/hammer https://github.com/ExHammer/hammer).

enraged_camel 3y ago

It says the book is in beta. How complete/finished is it?

seanmor5 3y ago
Hey, I'm the author! All of the chapters are done, but there are still some minor updates as APIs change. It should be going to production soon
- enraged_camel 3y ago
  Nice. Just placed an order.

jonvk 3y ago

I'm guessing you mean that you would recommend it. You say you can't.