3 ms·
I didn’t know what RWKV.cpp was, so hopefully this helps others: https://github.com/RWKV/rwkv.cpp https://github.com/RWKV/rwkv.cpp > INT4/INT5/INT8 and FP16 in
by notamy 2y ago
I didn’t know what RWKV.cpp was, so hopefully this helps others: https://github.com/RWKV/rwkv.cpp https://github.com/RWKV/rwkv.cpp
> INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model