4 ms·

there is also a python wrapper that has a web ui built in for llama.cpp, if it wasnt easy enough already