3 ms·
If you're on a Mac, https://lmstudio.ai https://lmstudio.ai is a quick way to get things running with a decent UI and a REST API that is compatible with OpenAI
by int_19h 2y ago
If you're on a Mac, https://lmstudio.ai https://lmstudio.ai is a quick way to get things running with a decent UI and a REST API that is compatible with OpenAI (which is the de facto standard these days). And the GGUF models that it downloads can be used directly via llama.cpp, if you are so inclined later.