3 ms·
There is no examples or documentation on `CustomLLM` the README file has examples on `SystemLLM` and `OpenaiLLM` but there's no way for us to know if we need to
by jdmg94 1y ago
There is no examples or documentation on `CustomLLM` the README file has examples on `SystemLLM` and `OpenaiLLM` but there's no way for us to know if we need to bring in guff files, ollama, hugginface, etc.
- achrafmam2 1y agoI’ve added documentation on creating new LLM integrations in SwiftAI [https://github.com/mi12labs/SwiftAI/blob/main/Docs/Guides/custom-llm-integration.md https://github.com/mi12labs/SwiftAI/blob/main/Docs/Guides/cu...]. We also have a proof-of-concept using MLX-optimized models from Hugging Face [https://huggingface.co/mlx-community https://huggingface.co/mlx-community], which we’ll release once it’s ready.
- achrafmam2 1y agoWe added an experimental support for MLX see README [https://github.com/mi12labs/SwiftAI/?tab=readme-ov-file#locall-ai-using-mlx-experimental https://github.com/mi12labs/SwiftAI/?tab=readme-ov-file#loca...]. We also added an chat demo where you can interact with 20+ models [https://github.com/mi12labs/SwiftAI/tree/main/Examples/ChatApp https://github.com/mi12labs/SwiftAI/tree/main/Examples/ChatA...]