Llama models have been pretty easy to host. StableDiffusion was a real nightmare when it came out (and still is at times). Using docker has an initial threshol

Llama models have been pretty easy to host. StableDiffusion was a real nightmare when it came out (and still is at times). Using docker has an initial threshold you have to get over but once you do, everything becomes very easy in it. How you end up using docker matters very little once you get the concepts.