Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ https://vast.ai/ for under $1 an hour that should work for sma

Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ https://vast.ai/ for under $1 an hour that should work for small/medium models (I've mostly been playing with stable diffusion so I don't know what you'd need for an LLM off hand). Good GPUs and Apple hardware is pricey. Get a bit of automation setup with some cloud storage (e.g backblaze B2) and you can have a machine ready to run your personally fined tuned model rapidly with a CLI command or two. There will be a break even point of course. Though a major advantage of renting is you can move easily as the tech does. You don't want to sink large amounts of money into a GPU only to find the next new hot open model needs more memory than you've got.