3 ms·
Hi simon, is there a way to run the vision model easily on my mac locally?
by lowyek 2y ago
Hi simon, is there a way to run the vision model easily on my mac locally?
- simonw 2y agoNot that I’ve seen so far, but Ollama are pending a solution for that “soon”.
- v3ss0n 2y agoI doubt ollama team can do much about it. Ollama are just wrapper on top of heavy lifter
- deleted 2y ago[deleted]
- Patrick_Devine 2y agoThe draft PRs are already up in the repo.
- theaniketmaurya 2y agoYou can run it with LitServe (MPS GPU), here is the code - https://lightning.ai/lightning-ai/studios/deploy-llama-3-2-vision-with-litserve https://lightning.ai/lightning-ai/studios/deploy-llama-3-2-v...