navjordj

3 ms·

1. 1.▲
   by navjordj 2y ago

   Could you share some details on what algorithm you use to generate the puzzles?
2. 2.▲
   by navjordj 3y ago

   The original T5 models were trained with masked language modelling similar to BERT and afterwards also trained on a autoregressive task similar to GPT.
3. 3.▲
   by navjordj 3y ago

   I would be very suprised if this hasn't already been implemented since GPT-3/3.5