3 ms·Support for this landed in llama.cpp recently if anyone is interested in running it locally.by heavyset_go 11mo agoSupport for this landed in llama.cpp recently if anyone is interested in running it locally.