2 ms·

To add to the discussion, from a practical perspective, AMD hardware totally sucks and yet to have proper implementation with flash-attention-2. ROCm is moving

To add to the discussion, from a practical perspective, AMD hardware totally sucks and yet to have proper implementation with flash-attention-2. ROCm is moving to usable slowly, but not close to being even comparable with cuda.

LarsDu88 2y ago
Whi os it so hard to port FA2 to the m1300 instinct?
- latchkey 2y ago
  https://github.com/kailums/flash-attention-rocm https://github.com/kailums/flash-attention-rocm