3 ms·

I had a 5090 some months ago but couldnt get flash attention to work. Does it now work natively? What about 5080?

• sigmoid10 1y ago
  Pytorch now has native support for the Blackwell architecture: https://pytorch.org/blog/pytorch-2-7/ https://pytorch.org/blog/pytorch-2-7/
  • SynasterBeiter 1y ago
    It does, but the performance is pretty bad, worse than Hopper.
• zackangelo 1y ago
  Curious what issues you were having. The kernel should compile natively if you pass nvcc the correct arch flags, although it probably won't take advantage of any new hardware features.
  • saagarjha 1y ago
    High-performance GPU code typically uses nonportable features that are not supported across generations.