This really isn't an elaboration on the grandparent comment but if you are interested in general in learning how Elixir excels at data pipelines I'd suggest loo

This really isn't an elaboration on the grandparent comment but if you are interested in general in learning how Elixir excels at data pipelines I'd suggest looking at this library: https://hexdocs.pm/broadway/Broadway.html https://hexdocs.pm/broadway/Broadway.html