3 ms·
I just want to note that in house platform can also be a big cost savers vs public clouds. For example, you should be able to be 10x cheaper on GPU compute if
by streetcat1 7y ago
I just want to note that in house platform can also be a big cost savers vs public clouds.
For example, you should be able to be 10x cheaper on GPU compute if you use consumer GPUs in-house.
From a conversation that I had with an academic IT person, he managed to save 2M$ yearly.
- mushufasa 7y agoI wonder if AMD will try to change that in the next couple years. AFAIK the reason for this is some clever licensing clauses by NVIDIA that effect market segmentation. If there were more competition on the high end, there would be downward pricing pressure.
- streetcat1 7y agoI agree. Another option would be custom chips for inference or training. IF we can get something like a TPU in house.
- anon9001 7y agoIt's also annoying because SR-IOV would be a wonderful thing for consumer GPUs, but it would make it too easy to use consumer GPUs for cloud providers. Right now, you can run a VM with qemu and pass through the GPU to the guest OS, getting pretty close to native performance. With SR-IOV, every VM could have the same GPU attached, and you could manage performance with the hypervisor. This would let you toggle between VMs instantly, getting full performance on each one (assuming the others are idle). AMD and nVidia do make SR-IOV cards, but they're extremely expensive, intended for data centers, and don't have display output. If it ever hits consumer cards, Linux will be the hypervisor of choice for pretty much everyone, because there will be minimal performance penalty for using VMs.
- latchkey 7y agoFor reference: https://community.amd.com/community/radeon-instinct-accelerators/blog/2019/11/01/what-is-sr-iov-why-it-s-the-gold-standard-for-gpu-sharing https://community.amd.com/community/radeon-instinct-accelera... https://www.amd.com/en/graphics/workstation-virtual-graphics https://www.amd.com/en/graphics/workstation-virtual-graphics https://www.reddit.com/r/Amd/comments/aemr9x/sriov_now_is_the_time_to_push_for_this_feature/ https://www.reddit.com/r/Amd/comments/aemr9x/sriov_now_is_th...
- latchkey 7y agohttps://www.blockchaintechnology-news.com/2019/01/07/consensys-partners-with-amd-and-halo-holdings-to-create-w3bcloud/ https://www.blockchaintechnology-news.com/2019/01/07/consens...