3 ms·
What enables this? There's a huge gap between GPT-3.5 and 4, put there by a massive amount of money, from my understanding. To compete, with open source proje
by nomel 3y ago
What enables this?
There's a huge gap between GPT-3.5 and 4, put there by a massive amount of money, from my understanding.
To compete, with open source projects being less well funded, I would assume that orders of magnitude improvements in training cost would be required. What do you see driving this, and who do you see paying for it?
If Meta, or anyone else, gets something that beats GPT-4, I would naively assume they would monetize it. If someopen source effort manages to beat GPT-4, then I assume some well funded, profit seeking, entity will dump orders of magnitude more money into whatever enabled the open source offerings to compete.
I don't think GPT-4 is the pinnacle of OpenAI, or that their funding will run dry, so they shouldn't be viewed as a static entity.
- ramesh31 3y ago>Or, are you suggesting that GPT-4 is the pinnacle of OpenAI, or that their funding will run dry? My bet is that Meta has pivoted almost entirely to this space with their R&D in the last six months. Llama 2 is spectacular. And with its' success, there will undoubtedly be more. They also happen to have access to limitless amounts of compute, cash, and engineering that puts OpenAI to shame. This could finally be their chance to create a platform for real. And the open source community and startups will benefit off of that.
- deleted 3y ago[deleted]
- nomel 3y agoWhat motive do you see for them releasing these models for free, especially with the massive increase in cost associated with catching up?
- ramesh31 3y ago> What motive do you see for them releasing these models for free, especially with the massive increase in cost associated with catching up? Owning a platform. Zuck's dream. They put tons of money into these models, nurture an ecosystem of companies built around them, and then start gradually figuring out a licensing model for the ones that take off.
- littlestymaar 3y agoKill Op*nAI, for starter. If they see it as a threat, commoditizing the tech is a great way to get rid of them at a reasonable cost.
- deleted 3y ago[deleted]
- nmfisher 3y agoI haven't tried Llama 2 yet - what specifically makes you say it's spectacular? The licensing or the model itself?