3 ms·
PowerRetention: a drop-in replacement for FlashAttention in LLMs
- dvrp 1y agoHere’s an article I found from Manifest AI, the company behind Power Retention: https://manifestai.com/articles/what-is-power-retention/ https://manifestai.com/articles/what-is-power-retention/
- jacobbuckman 1y agoI am one of the authors, happy to answer any questions!