3 ms·
Interesting company. Yannic Kilcher interviewed Nir Shavit last year and they went into some depth: https://www.youtube.com/watch?v=0PAiQ1jTN5k https://www.yout
by RossBencina 3y ago
Interesting company. Yannic Kilcher interviewed Nir Shavit last year and they went into some depth: https://www.youtube.com/watch?v=0PAiQ1jTN5k https://www.youtube.com/watch?v=0PAiQ1jTN5k
DeepSparse is on GitHub: https://github.com/neuralmagic/deepsparse https://github.com/neuralmagic/deepsparse
- anonymousDan 3y agoNir Shavit is co-author of IMO the best book on concurrent programming: https://dl.acm.org/doi/book/10.5555/2385452 https://dl.acm.org/doi/book/10.5555/2385452
- mark_l_watson 3y agoThanks for the GitHub link, I want to try this in a M2 with 32G memory. It will “waste” the GPU and neural cores, but might still run fast. Off topic: I so much appreciate everyone’s work Getting LLMs running on inexpensive hardware! I have been having crazy amounts of fun with Ollama and a wide variety of tuned models. And, so fast!