4 ms·
I expect LibNC will be better in every aspect: performance, accuracy, determinism. But hopefully with time we will close the gap.
by ggerganov 4y ago
I expect LibNC will be better in every aspect: performance, accuracy, determinism. But hopefully with time we will close the gap.
- hardwaresofton 4y agorefreshingly humble take -- thanks for your hard work. The work you've done and put out in the open is massive.
- liuliu 4y agoThe comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.