4 ms·
For a company that's very affordable, for an individual we're not there yet but I've seen some impressive demos running on a M1/M2 laptop so no doubt time will
by LaurensBER 3y ago
For a company that's very affordable, for an individual we're not there yet but I've seen some impressive demos running on a M1/M2 laptop so no doubt time will bring down the hardware requirements even more (and hopefully the price of used 3090s as well).
- LoganDark 3y agoRWKV is also fairly performant on CPU. disclaimer: recently did a bunch of work on rwkv.cpp.