The only reason to have a local model right now is for privacy and hobby. The economics are awful and local model performance is pretty lackluster by compariso

The only reason to have a local model right now is for privacy and hobby. The economics are awful and local model performance is pretty lackluster by comparison. Never mind much slower and narrower context length. $6,000 is 2.5 years of a $200/mo subscription. And in 2.5 years that $6k setup will likely be equivalent to a $1k setup of the time.