4 ms·
Ok now we need 1541 flash attention. I'm not sure what the venn diagram of knowledge to understand what that sentence is suggesting looks like, it's probably m
by Lerc 6mo ago
Ok now we need 1541 flash attention.
I'm not sure what the venn diagram of knowledge to understand what that sentence is suggesting looks like, it's probably more crowded in the intersection than one might think.
- dnnddidiej 6mo agoHow many 40+ AI pillers? Assume 10M devs in the world. 10% heard of flash attention, 1% heard of 1541 then 10,000
- Lerc 6mo agoAhh but you also have to know the significance of the 1541 that makes the Flash attention reference work
- gizmo64k 6mo agoBelieve me, using the 1541 as co-processor and extra storage was super tempting and on my mind all the time! So what do you think? Flash attention with K on the front side and V on the backside? :)
- gizmo64k 6mo ago..and we would keep the human in the loop:)