2 ms·You can offload the vision projector to CPU/sysRAMby 7speter 18d agoYou can offload the vision projector to CPU/sysRAMslim 18d agoAwesome. How would you setup that ?skirmish 17d ago--no-mmproj-offload See the documentation: https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md https://github.com/ggml-org/llama.cpp/blob/master/docs/multi...