3 ms·
Yeah, but in case of ELMo it was fine-tuning (training of pretrained language model and task model together), not just transfer learning.
by riku_iki 8y ago
Yeah, but in case of ELMo it was fine-tuning (training of pretrained language model and task model together), not just transfer learning.
- phowon 8y agoWith ELMo, the pretrained weights are frozen. Only the scalars for ELMo layers are tuned (as well as the additional top-level model, of course).