Sure you could and I bet there are a number of VC backed startups that do only this. But there's usually a lot of reasons why these architectures could be a us

Sure you could and I bet there are a number of VC backed startups that do only this. But there's usually a lot of reasons why these architectures could be a useful reference. In my project, I host my own trained LLM and one of the cost efficiencies comes from being able to cache at every step along the way. Then there is a large private media hosting consideration. There is room for all sorts of setups and I kind of liked how the article mapped out some of the common paths.