4 ms·
I think the key application here is spec decoding. This solves the deprecation problem pretty nicely, and will likely have huge performance benefits
by khoss 2mo ago
I think the key application here is spec decoding. This solves the deprecation problem pretty nicely, and will likely have huge performance benefits