3 ms·
>I have heard that transformer stacks can add "wrapping/unwrapping overhead", mtl-style final encodings can help here, from what I understand. `mtl` has won an
by coolsunglasses 11y ago
>I have heard that transformer stacks can add "wrapping/unwrapping overhead",
mtl-style final encodings can help here, from what I understand. `mtl` has won any benchmark I've seen, over concrete transformer stacks, Free, and others.