4 ms·
I haven't tried that but https://github.com/abetlen/llama-cpp-python https://github.com/abetlen/llama-cpp-python and https://github.com/r2d4/openlm https://gith
by rain1 3y ago
I haven't tried that but https://github.com/abetlen/llama-cpp-python https://github.com/abetlen/llama-cpp-python and https://github.com/r2d4/openlm https://github.com/r2d4/openlm exists