5 ms·Alpaca already works in just 4GB of RAM. This stuff is moving incredibly fast.by pbronez 4y agoAlpaca already works in just 4GB of RAM. This stuff is moving incredibly fast.astrange 4y agoIt doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)dachryn 4y agoalpaca lora is quite capable actually and is suddenly gaining a hell of a lot of traction in the corporate world