2 ms·
Everybody builds one. And, then they usually figure out that making the model fill its context with a bunch of memories hurts performance more often than it hel
by SwellJoe 5mo ago
Everybody builds one. And, then they usually figure out that making the model fill its context with a bunch of memories hurts performance more often than it helps.
- zaydmulani 5mo ago[dead]
- esafak 5mo agoThat's why I always ask: got benchmarks?
- zaydmulani 5mo agoYes — cargo run -p mnemo-bench. Ships with 12 benchmarks. Full retrieval pipeline is ~4ms on debug build. Numbers are in the README performance table.
- SwellJoe 5mo agoI don't care if it's fast, if it makes the model dumber by cluttering up context.
- zaydmulani 5mo ago[flagged]
- kdkdkdjdksksn 5mo ago[dead]