llama.cpp already has OpenAI compatible API. It takes literally one line to install it (git clone and then make). It takes one line to run the server as menti

llama.cpp already has OpenAI compatible API. It takes literally one line to install it (git clone and then make). It takes one line to run the server as mentioned on their examples/server README. ./server -m <model> <any additional arguments like mmlock>