4 ms·Thank you! Flash attention gives me a boost to ~66 tok/s indeed.by hrpnk 1y agoThank you! Flash attention gives me a boost to ~66 tok/s indeed.