2 ms·
Badass. I've spent the last week digging into ARM optimization for these models because it's really fascinating how close we are to local deployment for this st
by smoldesu 4y ago
Badass. I've spent the last week digging into ARM optimization for these models because it's really fascinating how close we are to local deployment for this stuff - writeups like these should help spread awareness.
- dnth 4y agoThanks a lot there! I was hesitating to write this piece actually, thinking it's not going to be valuable. I'm glad you find value in them!
- synctext 4y agoThnx for writing! In academia we're getting the next step operational: training on Android. Any advise for us what to watch out for? Obviously you need a bit of patience and lots of volunteer devices. With unsupervised continuous learning this is solved, in emulation. See "G-Rank: Unsupervised Continuous Learn-to-Rank for Edge Devices in a P2P Network" [1]. Optimal learning rate is left as an exercise for the developer. (disclaimer: our own work, I run a lab with "systems for peer-to-peer machine learning") [1] https://arxiv.org/abs/2301.12530 https://arxiv.org/abs/2301.12530
- dnth 4y agoYou're welcome! I'm not sure if I'm the right person to advise on this. But this idea is also known as federated learning right?