2 ms·
I could really see this taking off. Sagemaker is garbage and hugging face interfaces are laggy and buggy. The future is on-prem bespoke models you can run on co
by mise_en_place 2y ago
I could really see this taking off. Sagemaker is garbage and hugging face interfaces are laggy and buggy. The future is on-prem bespoke models you can run on commodity NPU SoCs. On my M3 MacBook I’ve been running local models like Llama-70B instead of ChatGPT for a while now.