3 ms·
They just clone it a few times and call it multi head attention. 2 doesn’t really make sense. 3 is the right number.
by naveen99 3y ago
They just clone it a few times and call it multi head attention. 2 doesn’t really make sense. 3 is the right number.