MORE EDITS: There are quite a few other differences vs attention that look significant. Preliminary and hand-wavy: Like other capsule-routing networks, this one

MORE EDITS: There are quite a few other differences vs attention that look significant. Preliminary and hand-wavy: Like other capsule-routing networks, this one gives us credit assignments that tell us how much each capsule (token embedding) in the output sequence depends on each capsule (token embedding)in the input sequence. Unlike other capsule-routing networks, this one seems to scale up really well, even though V has n x m x d elements, vs. n x d in attention.