3 ms·
I am. The underlying tech is amazing. Where LLMs are headed is wild. I have just lost a lot of confidence that OpenAI will be the ones getting us there. The
by kromem 3y ago
I am.
The underlying tech is amazing. Where LLMs are headed is wild.
I have just lost a lot of confidence that OpenAI will be the ones getting us there.
The chat niche was an instance of low hanging fruit for LLM applications.
But to design the core product offering around that was a mistake.
Chat-instruct fine tuning is fine to offer as an additional option, but to make it the core product was shortsighted and is going to hold back a lot of potential other applications, particularly as others have followed in OpenAI's footsteps.
There's also the issue of centrally grounding "you are a large language model" in the system messaging for the model.
So instead of being able to instruct a model "you are an award winning copywriter" it gets instructed as "you are a large language model whose user has instructed you to act as an award winning copywriter."
Think about the training data for the foundational model - what percent of that was reflecting what a LLM would output? So there's this artificial context constraint that ends up leaving to a significant reduction in variability across multiple prompts between their ChatCompletion and (depreciated) TextCompletion APIs.
They seem like a company that was adequately set up to deliver great strides with advancing the machine learning side of things, but then as soon as they had a product that exceeded their expectations, they really haven't known what to do with it.
So we have a runaway success while there's still a slight moat against other competition and they have a low hanging fruit product.
But I'm extremely skeptical given what I've seen in the past 12 months that they are going to still be leading the pack in 3 years. They may, like many other companies that were early on in advancing upcoming trends, end up victims of their own success by optimizing around today and not properly continuing to build for tomorrow.
If you offered me their stock at a current valuation with the stipulation I wouldn't be able to sell for 5 years, I wouldn't touch it with a 10 meter stick.