15 ms·
> Every dependency is either vendored or pinned, including some critical things that have no ABI guarantees like Eigen, which is literally pinned to some random
by kortex 5y ago
> Every dependency is either vendored or pinned, including some critical things that have no ABI guarantees like Eigen, which is literally pinned to some random commit,
starts sweating from GDAL PTSD
I hadn't heard about dh-virtualenv. That looks super convenient, I'll definitely give that a shot.
Honestly I've been kinda leaning into Conda-in-Docker images (so you can isolate while you isolate, dawg), which actually isn't so bad with a custom SHELL directive so you can RUN in a conda env. So many of my customers use it and provide algos developed in conda that it's often just easier to grab their environment.yml and stick it all in a container for deployment.
The pre-cooked TF image are a godsend but also the instant you need two different versions of TF in the same pipeline, you're hosed. I've been playing with Argo Workflows to get around this.
ML software packaging is the worst.
- mikepurvis 5y ago> two different versions of TF in the same pipeline Or if you just need to integrate with anything else whose deployment model is "lol here's a container."