3 ms·
Lack of capital and (probably) lack of willingness to mass distill Anthropic and OpenAI.
by mike_hearn 4mo ago
Lack of capital and (probably) lack of willingness to mass distill Anthropic and OpenAI.
- plufz 4mo agoWhat would happen if they mass distilled one of the really large local models like GLM 700b or deepseek 1.6t?
- grim_io 4mo agoAt that point you might as well just host them yourself.
- sajithdilshan 4mo agoThat's not how the innovation works
- weezing 4mo agoInnovation is teaching your model on stolen data from literally everywhere but other models.
- kelipso 4mo agoInnovation is a pretty neutral concept. It doesn’t care about things like “what if my model learns from other models” as opposed to “what if my model learns from data I painfully curated” if the model progresses the same.
- sulam 4mo agoThose already exist.