3 ms·
You can either modify the Android example inside llama.cpp or my fork of it at GitHub.com/iakashpaul/portal Increase the Ctx to more than 100 & link to any Q4
by iAkashPaul 2y ago
You can either modify the Android example inside llama.cpp or my fork of it at GitHub.com/iakashpaul/portal
Increase the Ctx to more than 100 & link to any Q4 GGUF of 7B