4 ms·
Happy to post mine (which is also not behind throwaway handle). Machine: 2021 Macbook Pro with M1 Max 32GB LLMs I usually use: Qwen 2.5 Coder 7B for coding an
by hobofan 2y ago
Happy to post mine (which is also not behind throwaway handle).
Machine: 2021 Macbook Pro with M1 Max 32GB
LLMs I usually use: Qwen 2.5 Coder 7B for coding and the latest Mistral or Gemma in the 4B-7B range for most other stuff
For interactive work I still use mostly Cursor with Claude, but for scripted workflows with higher privacy requirements (and where I don't want to be hit with a huge bill due to a rogue script), I also regularly use those models.
If you are interested in running stuff locally take a look at /r/LocalLLaMA [0] which usually gives good insights into what's currently viable for what use cases for running locally. A good chunk of the power-users there are using dedicated machines for it, but a good portion are in the same boat as me and trying to run whatever can be fit on their existing local machine, where I would estimate the coding capbilities to lag ~6-9 months in comparison to the SOTA big models (which is still pretty great).
[0]: https://www.reddit.com/r/LocalLLaMA https://www.reddit.com/r/LocalLLaMA