2 ms·How to Optimize Scaled Dot Product Attention?2 points by yash-sri19 2y agoyash-sri19 2y agoIn this worklog, I explore how to optimize SDPA across cache, quantization and device specific optimizations.