4 ms·
It should be noted that DeepSeek routinely claims to be a "language model trained by OpenAI", so it's pretty clear that it wasn't trained at 10x less cost from
by int_19h 2y ago
It should be noted that DeepSeek routinely claims to be a "language model trained by OpenAI", so it's pretty clear that it wasn't trained at 10x less cost from scratch, but rather on synthetic output generated by ChatGPT.
Not to point a finger at DeepSeek specifically; this is generally the case for best open source models right now. The best LLaMA finetunes tend to also use ChatGPT-generated synthetic datasets a lot.
Either way, it's unclear what the real cost is when you factor that in.
- Eisenstein 2y agoIf that was the case why are they 10x cheaper than the competition? If everyone is doing it there would be no gains over competitors.