3 ms·What are my options for running llama 2 on a single 3080?by shostack 3y agoWhat are my options for running llama 2 on a single 3080?brucethemoose2 3y agoLlama.cpp, through kobold.cpp, offloading some of it to ram.