3 ms·
Sure. But it would be very weird to use a position embedding here, when the whole point is permutation invariance.
by bjornsing 5y ago
Sure. But it would be very weird to use a position embedding here, when the whole point is permutation invariance.