The other answers are recommending paths which give you #1. less control and #2. projects with smaller eco-systems. If you want a truly general purpose front-e

The other answers are recommending paths which give you #1. less control and #2. projects with smaller eco-systems. If you want a truly general purpose front-end for LLMs, the only good solution right now is oobabooga: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui All other alternatives have only small fractions of the features that oobabooga supports. All other alternatives only support a fraction of the LLM backends that oobabooga supports, etc.