(A) is very use case depending. Even with some of the bad smaller models now, I can see devs making use of them to enhance their app (e.g. local search, summari

(A) is very use case depending. Even with some of the bad smaller models now, I can see devs making use of them to enhance their app (e.g. local search, summaries, sentiments, translations) (B) llama.cpp supports gpt4all, which states that its working on fixing your concern. This is from their README: Roadmap Short Term - Train a GPT4All model based on GPTJ to alleviate llama distribution issues.