3 ms·
Kudos for Google and happy to see that at least in principle AMD is still an option. I wonder what kind of device driver does GCE use with AMD, the new ROCm?
by slizard 10y ago
Kudos for Google and happy to see that at least in principle AMD is still an option.
I wonder what kind of device driver does GCE use with AMD, the new ROCm?
What about Power8 + NVLink harware? Does anybody know if the current NVIDIA GPUs, in particular the P100s are all on x86?
- boulos 10y agoI'll just answer your driver question: you bring whatever you want. Our VMs just boot off of bytes you have stored in your image (which is in turn just stored on GCS). If those bytes happen to be Debian 8 with some AMD driver that supports the 9300, awesome ;). We will be working with both vendors to make sure we highlight which drivers work most reliably on our stack though (virtualization + GPUs is way too rare!). We want to work closely with both vendors to do the qualification, so you at least know what is known good. Disclosure: I work on Google Cloud.
- puzzle 10y agoWhen is Kubernetes support going to be added? Right now it has it only in a very basic form for NVIDIA GPUs.
- eudoxus 10y agoThere is a PR[1] to extend the current alpha GPU implentation. Hopefully it will get merged soon. [1] - https://github.com/kubernetes/kubernetes/pull/28216 https://github.com/kubernetes/kubernetes/pull/28216
- puzzle 10y agoThat's still NVIDIA-only, plus you can't even tell a P100 from a K80 for scheduling purposes.
- boulos 10y agoI'd just use a separate NodePool and match your jobs using a selector as appropriate.
- puzzle 10y agoSo, is gci going to come with the right drivers?
- nanliu 10y agoThis is the reason node-feature-discovery exists. Kubernetes needs an extensible way to detect and label hardware features: See: https://github.com/kubernetes-incubator/node-feature-discovery https://github.com/kubernetes-incubator/node-feature-discove...
- slizard 10y agoThanks for the explanation, that's what I guessed -- which has both good & bad aspects. The good is the flexibility, the bad is that: > If those bytes happen to be Debian 8 with some AMD driver that supports the 9300, awesome ;). happens to support might alone not be enough given how much difficulties AMD has been having. I just hope that there will be enough customer demand for their SPFlop cruncher GPUs for interested parties -- including Google -- to pitch and contribute to their ROCm stack.