3 ms·
Would using llama as the llm teacher for a commercial model mitigate licensing concerns since it's not being used directly but only to create a separate artifac
by jerrygenser 3y ago
Would using llama as the llm teacher for a commercial model mitigate licensing concerns since it's not being used directly but only to create a separate artifacts?
What could impact the ability to discern whether it's llama or open llama? Are there artifacts of a given Llm that could be exposed via distilling process?
- wongarsu 3y agoNot a lawyer, but I think that depends on who's training this model for what purpose? If you're training the second model specifically to be able to use a llama-like model commercially, that's arguably a for-profit use of llama. On the other hand, if somebody else distills knowledge with llama in order to make a better model, and happens to release it for free without having a commercial use for it themselves it should be fine.