vlejd

4 ms·

1. 1.▲
   by vlejd 10mo ago

   This is awesome. I have been trying to track similar things mainly to identify brands of cloths that actually last long enough to be worth it. How do you keep the discipline to do this? I also assume it is very nice to have such list if som
2. 2.▲
   by vlejd 10mo ago

   Interestingly enough, we found that cublas is not that well optimized for some less common consumer GPUs, specifically 3090. We saw that is didn't really achieve it's full potential for a lot of different matrix shapes, probably b
3. 3.▲
   by vlejd 10mo ago

   I think the lack of efficient GPU kernels was the main problem. It is much, much easier to get a real speedup and memory reduction from quantization from fp16 to fp8 than from 50% sparsity. For sparsity you needed structure (which makes you
4. 4.▲
   Show HN: Sparse Matrix-Vector Multiplication that works at 30–90% sparsity(github.com)

   7 points by vlejd 10mo ago|5 comments
5. 5.▲
   by vlejd 10mo ago

   Internet is dead indeed. Amazing idea! Will use it to test my posts.
6. 6.▲
   by vlejd 10mo ago

   Thant looks very nice. I am writing some technical blogs from time to time and this will come in handy. How does it work with the code execution though? Are you running some service somewhere that takes care of it, or is it in browser?