4 ms·

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the m

by liuliu 4y ago

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.

ggerganov 4y ago
Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!
- liuliu 4y ago
  Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)