4 ms·
Somewhat related: is it worth it to use a P100 or P40? I was gonna get one but seems like pascal isn't being supported by more and more projects.
by graphe 3y ago
Somewhat related: is it worth it to use a P100 or P40? I was gonna get one but seems like pascal isn't being supported by more and more projects.
- danielhanchen 3y agoP100 - oh my so Xformers for Flash Attention I think does support it, but Triton supports Compute Capability 7.0+, whilst a P100 is 6.0 :( So technically the code can run, but I'll have to edit it to remove the Triton changes.
- graphe 3y agoThank you! I generally don't see as much support for them and needs to use old versions of it was supported. This trend is happening more and more, it's unfortunate but it seems like we need to use a newer GPU now.
- danielhanchen 3y agoYe unfortunately :( I tried my best to support all GPUs from 2018 onwards - for eg sadly Flash Attention v2 is only Ampere+, whilst Xformers is nicely Tesla T4+