Host an llm runner for the AI horde. I would suggest Aphrodite, which is faster and loads it down better, but you can also run Kobold.cpp which is much easier

Host an llm runner for the AI horde. I would suggest Aphrodite, which is faster and loads it down better, but you can also run Kobold.cpp which is much easier to set up.