3 ms·
Well, that's pretty impressive. Care to share your setup to do that? How much DDR3/DDR4 do you have, too?
by doodlesdev 4mo ago
Well, that's pretty impressive. Care to share your setup to do that? How much DDR3/DDR4 do you have, too?
- bitwize 4mo agoI... downloaded a 4-bit quantized GGUF of the model, used llama.cpp to run it, and pointed OpenCode at that. My machine is an 8-core Gen1 Ryzen 7, 32 GiB of DDR4, (I think) 4 GiB of VRAM on the graphics.
- doodlesdev 4mo agoWell... That's much simpler than I imagined LOL, thank you for answering!