2 ms·
It's absolutely possible, but on an M4 mac the largest / slowest model I could feasibly run was very inferior, compared to the default paid Cursor experience.
by animuchan 1y ago
It's absolutely possible, but on an M4 mac the largest / slowest model I could feasibly run was very inferior, compared to the default paid Cursor experience.
I tested with Kilo Code: https://kilocode.ai/ https://kilocode.ai/ -- it's a VS Code / Cursor extension.
To host models on desktop, there's this: https://ollama.com/ https://ollama.com/