4 ms·

For MLX I'd guess.

• redrove 7mo ago
  https://omlx.ai/ https://omlx.ai/
  • leftnode 7mo ago
    Does this have a CLI only interface?
    • redrove 7mo ago
      Yes. You could also look at the README.md.
• wronglebowski 7mo ago
  That also comes upstream from llama.cpp https://github.com/ggml-org/llama.cpp/discussions/4345 https://github.com/ggml-org/llama.cpp/discussions/4345