3 ms·
Distillation is great for researchers and hobbyists. But nearly all frontier models have anti-distillation ToS, so distillation is out of question for western
by rfv6723 1y ago
Distillation is great for researchers and hobbyists.
But nearly all frontier models have anti-distillation ToS, so distillation is out of question for western commercial companies like Apple.
- janalsncm 1y agoEven if Apple needs to train an LLM from scratch, they can distill it and deploy on edge devices. From that point, inference is free to them.