- A: You can convert models to MLC yourself, just like GGUF models, with relative ease. - B: Yeah, llama.cpp has a killer feature set. And killer integration w

- A: You can convert models to MLC yourself, just like GGUF models, with relative ease. - B: Yeah, llama.cpp has a killer feature set. And killer integration with other frameworks. MLC is way behind, but is getting more fleshed out every time I take a peek at it. - C: This is a pet peeve of mine, but I've never run into a local model that was really uncensored. For some, if you give them a GPT4 prompt... Of course you get a GPT4 response. But you can just give them a unspeakable system prompt or completion, and they will go right ahead and complete it. I don't really get why people fixate on the "default personality" of models trained on GPT4 data.