3 ms·
I'm surprised this is the case! I've been working on a rope implementation for my own project (needed to account for padding in unique situations) and even an o
by zackangelo 2y ago
I'm surprised this is the case! I've been working on a rope implementation for my own project (needed to account for padding in unique situations) and even an off by one error usually causes the model to produce non-sensical output.
- valine 2y agoYou have to be careful to keep the relative positions for adjacent and nearby tokens intact. The relative positions of distant tokens are less brittle.