Not only that, but these models are at some point superior. Even if AI companies offer embedding services, which some do not or only recently added such capabil

Not only that, but these models are at some point superior. Even if AI companies offer embedding services, which some do not or only recently added such capabilities, the best results are often a specifically tuned openly available model like llama. I do think this moat can still exist though, as providing a product is different than running a model somewhere, even if you have the compute power to allow prompting by a large amount of people. And making a model ready for the business user is quite a bit of work. Although true, the capabilities of commercial products will probably be eclipsed sooner rather than later. We saw that in image generation. Crowd sourcing the problem did produce better results. Generating videos is probably still locked behind enormous compute power (well, the 400+B model of Llama is too...) I think the focus of these companies isn't the performance of the model itself, it is providing interfaces to all kinds of systems and maybe solve a specific task.