This market of people willing to spend thousands to run large LLMs locally -- and still slowly -- has to be tiny. Plus, there's competitors using AMD CPUs that

This market of people willing to spend thousands to run large LLMs locally -- and still slowly -- has to be tiny. Plus, there's competitors using AMD CPUs that provide 128GB with 500GB/s of bandwidth (8xDDR5-8000) for just $2K now.[1] A Mac Studio with an M4 Max has similar bandwidth but costs $4k for similar specs; the M3 Pro has ~800GB/s of bandwidth but 256GB of RAM (there's no 128GB option) and 2TB of SSD will set you back $6k! [1] https://www.gmktec.com/products/amd-ryzen%E2%84%A2-ai-max-395-evo-x2-ai-mini-pc https://www.gmktec.com/products/amd-ryzen%E2%84%A2-ai-max-39...