4 ms·
At Channable, we have had a great experience introducing Haskell for our infrastructure projects. We have written a few blog posts about this which you can find
by rkrzr 7y ago
At Channable, we have had a great experience introducing Haskell for our infrastructure projects. We have written a few blog posts about this which you can find on our tech blog[1].
- Jobmachine, an advanced job-scheduling system with dynamic dependency resolution[2]
- Vaultenv, a small open-source tool to get secrets from Hashicorp vault[3][4]
- alfred-margaret, a blazingly-fast Aho-Corasick implementation written in Haskell[5][6]
- Sharkmachine, our in-house replacement for Apache Spark[7]
[1]: https://tech.channable.com/ https://tech.channable.com/
[2]: https://tech.channable.com/posts/2017-02-24-how-we-secretly-introduced-haskell-and-got-away-with-it.html https://tech.channable.com/posts/2017-02-24-how-we-secretly-...
[3]: https://tech.channable.com/posts/2017-07-06-introducing-vaultenv-keeping-your-secrets-safe-with-vault-and-haskell.html https://tech.channable.com/posts/2017-07-06-introducing-vaul...
[4]: https://github.com/channable/vaultenv https://github.com/channable/vaultenv
[5]: https://tech.channable.com/posts/2019-03-13-how-we-made-haskell-search-strings-as-fast-as-rust.html https://tech.channable.com/posts/2019-03-13-how-we-made-hask...
[6]: https://github.com/channable/alfred-margaret https://github.com/channable/alfred-margaret
[7]: https://tech.channable.com/posts/2019-10-04-why-we-decided-to-go-for-the-big-rewrite.html https://tech.channable.com/posts/2019-10-04-why-we-decided-t...
- silvester23 7y agoI could not find jobmachine on your GitHub page, am I correct in assuming it's not open source? We are currently in the process of building something similar and it would have been interesting to see your approach in more detail.
- pwm 7y agoNot OP, but here are 2 slightly different links that might be of interest: https://github.com/tweag/funflow https://github.com/tweag/funflow - A library for running computational workflows https://skillsmatter.com/skillscasts/14417-build-systems-a-la-carte https://skillsmatter.com/skillscasts/14417-build-systems-a-l... - a recent Haskell eXchange talk about build systems (corresponding paper: https://www.microsoft.com/en-us/research/uploads/prod/2018/03/build-systems-final.pdf https://www.microsoft.com/en-us/research/uploads/prod/2018/0...)
- rkrzr 7y agoYes, you are correct. We have not open-sourced Jobmachine yet, since it is still pretty specific for our workload, but I hope we can generalize and open-source it in the future.
- snagglegaggle 7y agoDon't wait to fix it. If you want to release it ask for it to be released. Doing anything else is being fake-open-source; the real reason you don't want to release it is because of some value you think it has, not that it would actively hurt other people through its design (how...?).