3 ms·
Any chance that the new NPUs are going to significantly speed up running these locally. Well I'm definitely worried about recall and all the Microsoft nonsense
by 999900000999 2y ago
Any chance that the new NPUs are going to significantly speed up running these locally.
Well I'm definitely worried about recall and all the Microsoft nonsense, I really want to be able to run and train LMMs, and other machine learning frameworks locally.
- irusensei 2y agoYou still need lots of fast memory.