4 ms·I’ve used llama.cpp easily for some local things, but it does lack a good ui.by tibbon 3y agoI’ve used llama.cpp easily for some local things, but it does lack a good ui.