3 ms·

llama-server from the llama.cpp package has a local web interface.

• steveharing1 5mo ago
  yes. I've used it a lot. its very simple and good