4 ms·
RoPE is somewhat related, I think, and it's pretty popular. There's also 2D rope for ViT, but I don't know how it works exactly.
by Scene_Cast2 1y ago
RoPE is somewhat related, I think, and it's pretty popular.
There's also 2D rope for ViT, but I don't know how it works exactly.