3 ms·
It's so trivially easy to create your own web server in your language of choice that calls directly into llama.cpp functions with the bindings for your language
by tracerbulletx 3y ago
It's so trivially easy to create your own web server in your language of choice that calls directly into llama.cpp functions with the bindings for your language of choice it doesn't really matter all that much. If you want more control you can get with just a little more work. You don't really need these plug and play things.