3 ms·
> BERT is only masking 15% of the tokens, so isn't the amount of dependency pairs like 18% higher at most? That's a small but significant difference, allowing
by yorwba 7y ago
> BERT is only masking 15% of the tokens, so isn't the amount of dependency pairs like 18% higher at most?
That's a small but significant difference, allowing them to improve performance by a small but significant amount.