2 ms·Best to replace attention addition with scaling and see.by mirekrusin 3y agoBest to replace attention addition with scaling and see.