4 ms·

BERT is already outdated, but still useful as you need only 1 Titan RTX to retrain its BERT_large model via transfer learning.

• turnersr 7y ago
  What methods make BERT outdated? Do you have pointers to other options?
  • bitL 7y ago
    e.g. XLNet: https://arxiv.org/abs/1906.08237 https://arxiv.org/abs/1906.08237
    • phreeza 7y ago
      XLnet is Bert with a bunch of additional training tricks.
      • bitL 7y ago
        BERT is a Transformer with a bunch of additional training tricks. Transformer is self-attention with a bunch of additional training tricks...