3 ms·Cascade Inference: Memory Bandwidth Efficient Shared Prefix Batch Decoding2 points by zhye 3y ago