2 ms·

Nvidia being making it clear that other hardware models will permanently not become second class citizens in any way would be a great start.

by j45 1mo ago

croes 1mo ago
Talk is cheap, so no need to claim that in the first place. Of course they could make it legally binding but they won't do it. They will be as free as the Washington Post after the aquisition by Bezos. Wait and see is the only thing we can do.
- Danox 1mo ago
  You haven’t been paying attention to Washington Post isn’t free to do anything they want under Jeff Bezos…
Const-me 1mo ago
For the last few months, I’ve been working on a vendor-agnostic inference library. Have 3 backends so far: legacy D3D11 for compatibility, D3D12, and Vulkan 1.3. I have reasons to believe nVidia deliberately crippling Vulkan API for their consumer GPUs. Couple examples to be specific. nVidia driver sets quite low number for VkPhysicalDeviceLimits::maxTexelBufferElements. I don’t think that’s a hardware limit because I have D3D12 backend doing the same thing on the same hardware. Vulkan performance is not great on nVidia. On all AMD cards I am testing, Vulkan 1.3 is the fastest backend. On nVidia however, D3D12 is faster despite tensor cores (WMMA / wave matrix multiply accumulate / cooperative matrices) are only available through Vulkan, D3D12 is using shader cores exclusively.
fn-mote 1mo ago
How could they control other hardware models? This is just one company. If other hardware is better and they don’t provide access to it, won’t people just leave HF?? Is this somehow more of a monopoly than I am imagining?
- j45 1mo ago
  Yes, they could just say they're taking it towards prioritizing models that only run on one kind of equipment and making it harder to find, support or list models that run on different hardware. The acquisition sets up corporate interests to be able to increasingly drive it. I hope better for Nvidia and hopefully it can be cleared up, and maintained.
  - asnelt 1mo ago
    Exactly. Just tweaking the order of suggested models for a search query could already have a huge impact on model popularity.

Nvidia being making it clear that other hardware models will permanently not become second class citizens in any way would be a great start.

by j45 1mo ago

Nvidia being making it clear that other hardware models will permanently not become second class citizens in any way would be a great start.

croes 1mo ago

Talk is cheap, so no need to claim that in the first place. Of course they could make it legally binding but they won't do it. They will be as free as the Washington Post after the aquisition by Bezos. Wait and see is the only thing we can do.

Danox 1mo ago
You haven’t been paying attention to Washington Post isn’t free to do anything they want under Jeff Bezos…

Const-me 1mo ago

For the last few months, I’ve been working on a vendor-agnostic inference library. Have 3 backends so far: legacy D3D11 for compatibility, D3D12, and Vulkan 1.3. I have reasons to believe nVidia deliberately crippling Vulkan API for their consumer GPUs. Couple examples to be specific. nVidia driver sets quite low number for VkPhysicalDeviceLimits::maxTexelBufferElements. I don’t think that’s a hardware limit because I have D3D12 backend doing the same thing on the same hardware. Vulkan performance is not great on nVidia. On all AMD cards I am testing, Vulkan 1.3 is the fastest backend. On nVidia however, D3D12 is faster despite tensor cores (WMMA / wave matrix multiply accumulate / cooperative matrices) are only available through Vulkan, D3D12 is using shader cores exclusively.

fn-mote 1mo ago

How could they control other hardware models? This is just one company. If other hardware is better and they don’t provide access to it, won’t people just leave HF?? Is this somehow more of a monopoly than I am imagining?

j45 1mo ago
Yes, they could just say they're taking it towards prioritizing models that only run on one kind of equipment and making it harder to find, support or list models that run on different hardware. The acquisition sets up corporate interests to be able to increasingly drive it. I hope better for Nvidia and hopefully it can be cleared up, and maintained.
- asnelt 1mo ago
  Exactly. Just tweaking the order of suggested models for a search query could already have a huge impact on model popularity.