4 ms·
agreed, if not for this project I've been making I would at least be using base llama.cpp Personally I think it comes down to simplicity, but there's no reason
by wowitsbase 26d ago
agreed, if not for this project I've been making I would at least be using base llama.cpp
Personally I think it comes down to simplicity, but there's no reason for it's performance drops compared to llama.cpp while it's a wrapper of it.