5 ms·

Show HN: UL-SMF – Open-source linear-complexity ~300x KV-cache compression

• liventruth 2mo ago
  [flagged]
• colingauvin 2mo ago
  This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.
  • liventruth 2mo ago
    [dead]
  • liventruth 2mo ago
    [flagged]
  • liventruth 2mo ago
    [flagged]