3 ms·
is llama405 a distilled model like DeepSeek or a trained frontier model? I honestly ask because I haven't researched but that's important to know before one com
by Jlagreen 2y ago
is llama405 a distilled model like DeepSeek or a trained frontier model? I honestly ask because I haven't researched but that's important to know before one compares.
- spott 2y agoDeepseek isn’t a distilled model (and neither is llama405), both are pre trained foundation models. Deepseek has distilled deepseek R1 into a couple of smaller open source models, but neither R1 or v3 are distilled themselves.