3 ms·Recent Developments in LLM Architectures: KV Sharing, MHC, Compressed Attention2 points by vismit2000 5mo ago