2 ms·
There's a llama.cpp fork (I think?) with a build in HTTP server for an API. I'm on mobile and can't find it right now though.
by nl 4y ago
There's a llama.cpp fork (I think?) with a build in HTTP server for an API.
I'm on mobile and can't find it right now though.