5 ms·
How does this compare to fine tuning something like BERT?
by swalsh 3y ago
How does this compare to fine tuning something like BERT?
- theaniketmaurya 3y agoI would say similar since the building block is the transformer for both. In this blog post, the fine-tuning strategy used is Adapter. It basically adds a learnable layer to the Transformer block.