3 ms·You can use it for speculative decoding for example, this would increase the speed of larger models.by GaggiX 2y agoYou can use it for speculative decoding for example, this would increase the speed of larger models.