41 ms·
Run LLMs Locally with Docker: A Quickstart Guide to Model Runner
- homarp 2y agoit uses llama.cpp
- kristianp 2y agoThis is part of docker desktop on MacOS. > Now available in Beta with Docker Desktop 4.40 for macOS on Apple silicon Also provides an api endpoint.
- homarp 2y agodiscussion here https://news.ycombinator.com/item?id=43643944 https://news.ycombinator.com/item?id=43643944