https://github.com/shreyaskarnik/DistiLlama https://github.com/shreyaskarnik/DistiLlama (not fully integrated, you have to start ollama separately, but it is al

https://github.com/shreyaskarnik/DistiLlama https://github.com/shreyaskarnik/DistiLlama (not fully integrated, you have to start ollama separately, but it is all local)