3 ms·

I think the argument behind is that XLNet retains all context regardless. Ultimately, it is the performance that speaks.