3 ms·
> Why introduce one more container? Who benefits from binary distribution of this sort? Mass adoption comes from ease-of-use, which includes ease-of-deployment
by ukuina 3y ago
> Why introduce one more container? Who benefits from binary distribution of this sort?
Mass adoption comes from ease-of-use, which includes ease-of-deployment.
Most of the HN crowd is savvy enough to run HF models directly in their terminal, but there's a reason Ollama, LM Studio, and Faraday are so popular.
Until LLM runners are part of the base OS, methods like this are extremely helpful to reduce friction.