4 ms·
13/s is not slow. Q4 is not bad. The models that run on phones are never 30B or anywhere close to that.
by hidelooktropic 1y ago
13/s is not slow. Q4 is not bad. The models that run on phones are never 30B or anywhere close to that.
- lostmsu 1y agoIt is very slow and totally unimpressive. 5060Ti ($430 new) would do over 60, even more in batched mode. 4x RPi 5 are $550 new.
- magicalhippo 1y agoSo clearly we need to get this guy hooked up with Jeff Geerling so we can have 4x RPi5s with a 5060 Ti each... Yes, I'm joking.
- deleted 1y ago[deleted]