3 ms·
Yes — cargo run -p mnemo-bench. Ships with 12 benchmarks. Full retrieval pipeline is ~4ms on debug build. Numbers are in the README performance table.
by zaydmulani 6mo ago
Yes — cargo run -p mnemo-bench. Ships with 12 benchmarks.
Full retrieval pipeline is ~4ms on debug build. Numbers are
in the README performance table.
- SwellJoe 6mo agoI don't care if it's fast, if it makes the model dumber by cluttering up context.
- zaydmulani 6mo ago[flagged]