3 ms·RWKV-5: increased heads, matrix-valued states, no positional encodings5 points by pizza 3y agodeleted 3y ago[deleted]