4 ms·
Hmm, the article's summary table showed "only the top task layer(s)" for BERT fine-tuning. Is that correct? The original paper [1] wrote: "All of the paramete
by yoquan 8y ago
Hmm, the article's summary table showed "only the top task layer(s)" for BERT fine-tuning. Is that correct?
The original paper [1] wrote:
"All of the parameters of BERT and W are fine-tuned jointly to maximize the log-probability of the correct label."
[1]: https://arxiv.org/abs/1810.04805 https://arxiv.org/abs/1810.04805
- lilianweng 8y agothanks! my text should be correct but the table is wrong. just fixed.