Van_Chopiszt

3 ms·

1. 1.▲
   Running LLMs with 3.3M Context Tokens on a Single GPU(arxiv.org)

   14 points by Van_Chopiszt 2y ago|1 comments
2. 2.▲
   by Van_Chopiszt 3y ago

   The authors just uploaded a FAQ section, which may clarify some of the confusions: https://github.com/mit-han-lab/streaming-llm/blob/main/READM...