3 ms·
> The Chinese labs pay much less to train their models because they distill Western models. That's nonsense.
by jacquesm 15d ago
> The Chinese labs pay much less to train their models because they distill Western models.
That's nonsense.
- hollerith 15d agoI'm going to take your comment as a request for supporting details. I believe what I wrote is an accurate summary of information in a report published this month by Anthropic. I haven't seen the report, but have seen this next summary written by someone who I trust to summarize accurately: https://thezvi.substack.com/p/the-bad-guy-with-an-ai-named-claude?open=false#%C2%A7illicit-fraudulent-distillation https://thezvi.substack.com/p/the-bad-guy-with-an-ai-named-c... OpenAI reported similar behavior last year. The assertion that the other (two) leading US models are being distilled in a similar manner is an assumption on my part. Where I wrote, "Claude or another leading US model" I initially had just "Claude", but it felt silly to imply that the same thing is not happening to the other leading US models.