3 ms·I am more interested on running llama.cpp on CPU-only VPSs/EC2. Although it is probably too slow.by ilaksh 3y agoI am more interested on running llama.cpp on CPU-only VPSs/EC2. Although it is probably too slow.rini17 3y ago13b versions of models are running on 8-core CPU fast enough to have a fluid conversation.borissk 3y agoWhat can I run on nVidia RTX 4060 Ti with 16GB RAM?rini17 3y agoBest to try yourself, llama.cpp is refreshingly easy to build.