3 ms·
Nice work, it would be great to see some benchmarks comparing it to llm.c.
by fuddle 2y ago
Nice work, it would be great to see some benchmarks comparing it to llm.c.
- littlestymaar 2y agoI doubt it would compare favorably at the moment, I don't think it's particularly well optimized besides using rayon to get CPU parallelism and wide for a bit of SIMD. It's good enough to get pretty good performance for little effort, but I don't think it would win a benchmark race either.