3 ms·
On one hand, I want to believe Sahil, on the other hand most of his explanations don’t make much sense: Can’t upload exact weights he had on his computer. The
by coolspot 2y ago
On one hand, I want to believe Sahil, on the other hand most of his explanations don’t make much sense:
Can’t upload exact weights he had on his computer. The guy runs AI hosting/inference/training company - can’t upload weights he has!
Original benchmark harness wasn’t shared, but had a bug that conveniently boosted model results.
API somehow mysteriously censors model name and tokenizer is exact match to Claude.
- all2 2y agoI've seen stuff like this hacked together. If he isn't very organized or was hasty, there's a good bet he deleted the working weights or doesn't know which of 5 or 10 the weights it is. Nothing would stop him from uploading all the weights, I suppose...
- ipsum2 2y agoNo. He served the "weights" (actually Claude) for over 24 hours. It's practically impossible to have served the "correct weights" and just have lost them.
- ameliaquining 2y agoHe seems to be claiming that anyone can now reproduce the weird Claude censorship locally with the uploaded weights. Has anyone checked whether that's true or not, or is he mischaracterizing the allegations?
- xena 2y agoI'm going to be downloading the weights and doing local verification
- BoorishBears 2y agoI think the most damning thing about this whole saga for all of AI is how much energy and attention people are giving it. In most established verticals, such a cartoonish scam would be dead on arrival. But apparently generative AI is still not mature enough to just move past this kind of garbage in a clean break.
- lostmsu 2y agoI think it is damning of the people who aren't paying attention, because this stuff at this trajectory is gonna be world changing pretty soon.
- xena 2y agoTo be fair, the AI industry is used to people manifesting out of nowhere doing something stupid and then ending up with revolutionary results. It's no surprise that there's a default optimism (especially if it pans out because then that makes running high quality AI stuff so much cheaper).
- refulgentis 2y agoIt's not a cartoonish scam, and if it was, it took 48 hours to fall apart. Not worth getting the Jump to Conclusions™ mat out for. This isn't said aggressively or to label, but rather, to provide some context that it's probably not nearly as simple as you are suggesting: this thread looks like a bunch of confused engineers linking drama threads from laymen on Twitter/Reddit to eachother, seeing pitchforks, and getting out their own. Meanwhile, the harsh conclusions they jump to are belied by A) having engineering knowledge _and_ looking into their claims B) reading TFA
- bubaumba 2y ago> I think the most damning thing about this whole saga for all of AI is how much energy and attention people are giving it. That's because there is nothing better today, and nothing like it in the history.