3 ms·
Looking forward to try it, but I don't have a macbook. I wonder if it runs on i7-11800h (8 core 16 thread CPU) with 64gb RAM
by tarruda 4y ago
Looking forward to try it, but I don't have a macbook. I wonder if it runs on i7-11800h (8 core 16 thread CPU) with 64gb RAM
- kristianp 4y agoWould that require porting llama to OpenVino?
- zitterbewegung 4y agoAlpaca.cpp is a derivative of llama.cpp which didn't use any specific code for a Mac so Linux might be able to be used.
- tarruda 4y agoThe answer is yes: It ran on a x86 virtual machine with 4 CPU threads and 12gb of RAM
- unshavedyak 4y agoI'm using this exact repo on Linux (NixOS), right now. Wish i could run the 60B model, this 7B model is a bit weird.