3 ms·You can offload the vision projector to CPU/sysRAMby 7speter 2mo agoYou can offload the vision projector to CPU/sysRAMslim 2mo agoAwesome. How would you setup that ?skirmish 2mo ago--no-mmproj-offload See the documentation: https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md https://github.com/ggml-org/llama.cpp/blob/master/docs/multi...