3 ms·
Kalosm 0.3: A Rust framework for local AI
- Evan-Almloff 2y agoKalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for: - Whisper for audio transcription - Llama, phi and mistral models for text generation. - Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation - Bert for text embedding and search The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements