2 ms·
There is a reason no one uses Apple for local models. Be careful not to fall for marketing and fanboyism. Just look at what people are actually using. Don't re
by PlatoIsADisease 9mo ago
There is a reason no one uses Apple for local models. Be careful not to fall for marketing and fanboyism.
Just look at what people are actually using. Don't rely on a few people who tested a few short prompts with short completions.
- mitjam 9mo agoyes, I'm using smaller models on a Mac M2 Ultra 32GB and they work well, but larger models and coding use might be not a good fit for the architecture, after all.