This makes sense to me. I think having components trained in-house is pretty important to building a moat, and probably requires a somewhat successful business

This makes sense to me. I think having components trained in-house is pretty important to building a moat, and probably requires a somewhat successful business beforehand to collect proprietary data. I'm a little doubtful of the value of using open source LLMs at the moment, even if fine-tuned, but this could change.