3 ms·
It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)
by astrange 4y ago
It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)
- dachryn 4y agoalpaca lora is quite capable actually and is suddenly gaining a hell of a lot of traction in the corporate world