3 ms·

Eh it’s not too bad on Linux as long as you use the official docker image that has cuda, cudnn, and tensorflow with matching versions. This also lets you use tf

by NavinF 5y ago

Eh it’s not too bad on Linux as long as you use the official docker image that has cuda, cudnn, and tensorflow with matching versions. This also lets you use tf1, tf2, and PyTorch in separate containers without upgrading cudnn in lockstep. Larger projects that use several models inevitably require all three. If you install it yourself, you’re in for a world of hurt.

hanselot 5y ago
I don't understand how anyone can be okay with: "Here, run this piece of code. No don't bother trying to read, build or understand it yourself, we know you won't be able to do it, so we put it in a little mystery box over here that you can run on top of your existing operating system. Now please don't ask any questions and go away."
- NavinF 5y ago
  Vouched, but you should know that literally all the comments on your account are [dead]. I can read and understand tf just fine and I’ve had to work around bugs (like the broken image resampling) by doing just that. Treating tf as a blank box has nothing to do with it. The problem is that nothing none of the ABIs involved here (tf, cudnn, distro libc, nvidia driver, etc) are stable. The best you can hope for is to use the same driver for several containers with matched (tf, libc, cudnn) and that’s worked out well for me in the last couple of years.
- moffkalast 5y ago
  Well that's basically all we do isn't it? Every exe you run on windows, every apt package you get on linux, every docker container, or node module, etc. Just layers and layers of running black boxes that nobody but the original developer knows much about. But even if you compile it yourself, what exactly are you gaining? Extra work for something you won't look into anyway? You'd think open source stuff would be more peer reviewed, but as a maintainer of a few open company repos it's surprising how much nobody actually cares and will just run whatever. Most of the time it works fine because the average person isn't a malicious actor, but every so often something gets compromised and it's always discovered by pure chance.
Filligree 5y ago
NixOS has this decently solved. “Some assembly required”, but at least you can switch between versions without messing up your system. So long as the driver doesn’t change, you can even run multiple versions simultaneously and nothing will break.
- moffkalast 5y ago
  Imagine having to install a different OS to run something, what year is this?
  - opan 5y ago
    Nix, the package manager, can at least be used on other distros.

by NavinF 5y ago

hanselot 5y ago

I don't understand how anyone can be okay with: "Here, run this piece of code. No don't bother trying to read, build or understand it yourself, we know you won't be able to do it, so we put it in a little mystery box over here that you can run on top of your existing operating system. Now please don't ask any questions and go away."

NavinF 5y ago
Vouched, but you should know that literally all the comments on your account are [dead]. I can read and understand tf just fine and I’ve had to work around bugs (like the broken image resampling) by doing just that. Treating tf as a blank box has nothing to do with it. The problem is that nothing none of the ABIs involved here (tf, cudnn, distro libc, nvidia driver, etc) are stable. The best you can hope for is to use the same driver for several containers with matched (tf, libc, cudnn) and that’s worked out well for me in the last couple of years.
moffkalast 5y ago
Well that's basically all we do isn't it? Every exe you run on windows, every apt package you get on linux, every docker container, or node module, etc. Just layers and layers of running black boxes that nobody but the original developer knows much about. But even if you compile it yourself, what exactly are you gaining? Extra work for something you won't look into anyway? You'd think open source stuff would be more peer reviewed, but as a maintainer of a few open company repos it's surprising how much nobody actually cares and will just run whatever. Most of the time it works fine because the average person isn't a malicious actor, but every so often something gets compromised and it's always discovered by pure chance.

Filligree 5y ago

NixOS has this decently solved. “Some assembly required”, but at least you can switch between versions without messing up your system. So long as the driver doesn’t change, you can even run multiple versions simultaneously and nothing will break.

moffkalast 5y ago
Imagine having to install a different OS to run something, what year is this?
- opan 5y ago
  Nix, the package manager, can at least be used on other distros.