3 ms·
The Chinese models are distilled from GPT and Claude, so it's not like China would pull ahead if those companies went away for six months. They really are at th
by stavros 7mo ago
The Chinese models are distilled from GPT and Claude, so it's not like China would pull ahead if those companies went away for six months. They really are at the forefront of innovation right now, as much as I hate to think of the consequences of this (a single company owning a superintelligence is basically a nightmare scenario for me).
- isodev 7mo agoI think that’s the realm of conspiracy theories. There are also not only Chinese alternatives- Mistral in Europe is doing pretty good in several categories they’ve opted to focus on. This kind of reiterates the parent’s question I think - people are maybe too focused on the gpt/claude model and forget about all the other ways of using the tech.
- stavros 7mo agoIs it? I thought it was pretty well established that open models were distilled from the proprietary, frontier ones. Maybe I'm wrong.
- airstrike 7mo agoNo, that is not well established at all, and generalizing all open models under that inaccurate umbrella doesn't really help anyone.
- ctolsen 7mo agoIt's well established that the companies who own the proprietary frontier models complain loudly that open models are distilled from theirs. There's surely some truth to it (and it's well deserved), but it's happening in every direction.
- largbae 7mo agoDon't worry, if someone truly achieves superintelligence it won't be controlled by anyone for long.
- chihuahua 7mo agoThere will be a blinding flash which signals the superintelligence singularity. When the smoke clears, you'll see a 50-foot tall Altman/Borg hybrid. He is about to destroy humanity with his death ray. Suddenly, a 50-foot tall Musk/Borg hybrid appears out of nowhere, and stops Altman just in time. Then they work together to destroy all humans.
- rl3 7mo agoSeems our best hedge in that case is Levi Ackerman.
- stavros 7mo agoThat's my other nightmare scenario :P
- georgemcbay 7mo agoJust imagine how inexpensive paperclips will become, there is always a silver lining. We will finally have achieved abundance.
- stavros 7mo agoNot just abundance, we will have the maximum amount of paperclips possible.
- electroglyph 7mo agoi don't buy this. distilled how? you don't get access to logprobs, and the thinking traces are fake and compressed. it's an expensive way to get potentially substandard training data.