4 ms·

Ask HN: Best UNCENSORED language model comparable to ChatGPT?

22 points by behnamoh 3y ago

wkat4242 3y ago
Are there even any? I think all the big players censor because they're afraid of the headlines "major AI product used to do <bad thing>". Perhaps llama considering it can be self hosted?
- Bran_son 3y ago
  > "major AI product used to do* <bad thing>" *say
  - wkat4242 3y ago
    I was thinking more about it helping people doing something bad, like write malware. In fact I expect the phishers will have a field day with this. I expect phishing to become a lot more targeted and accurate in the near future. And much harder to detect.
cratermoon 3y ago
What sort of censoring are you concerned about? What's excluded from ChatGPT that you want to use?
- porkbeer 3y ago
  Not op, but working on network code it suddenly refused asserting it could not help me make 'hacking tools', which was not the case. Furthermore, even if it was, those tools are legal and useful. Unwanted censorship abounds.
tikkun 3y ago
https://www.reddit.com/r/LocalLLaMA/wiki/models/ https://www.reddit.com/r/LocalLLaMA/wiki/models/ https://chat.lmsys.org/?arena https://chat.lmsys.org/?arena (Then click Leaderboard)
alpark3 3y ago
There's a bunch of LLaMA instruction-tuned variants on huggingface and new ones are coming out every day. I personally had the best experience with GPT4-x-vicuna: https://huggingface.co/NousResearch/gpt4-x-vicuna-13b https://huggingface.co/NousResearch/gpt4-x-vicuna-13b. There's more variants, and you can find information on them on https://www.reddit.com/r/LocalLLaMA https://www.reddit.com/r/LocalLLaMA. The best way for you to run the model is probably through https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp. This is a plain C/C++ implementation that can run LLMs pretty efficiently. It can run the LLaMA 13B variants at a pretty quick pace (~100 ms/token) on my M1 Pro macbook. I'd be happy to answer more questions.
- behnamoh 3y ago
  Thank you. As I'm new to this field, I have been grappling with some concepts like GGML vs GPTQ models, etc. It seems the GPTQ models only run on Linux, so your suggestion is right to use llama.cpp as that works with GGML and is compatible with M1 Macs as well. I had trouble running oobabooga on M1 Mac, something about Python arm64 vs x86_64... I didn't know about GPT4-x-Vicuna that you mentioned. Interesting to see that it's uncensored. I knew about Wizard-Vicuna-uncensored though. It seems like GPT4-x-Vicuna is similar.
juliensalinas 3y ago
You might want to try our ChatDolphin model on NLP Cloud that is very similar to Vicuna and uncensored: https://nlpcloud.com/home/playground/text-generation https://nlpcloud.com/home/playground/text-generation (select the ChatDolphin model at the top right). I hope it will be useful.
seydor 3y ago
I think this is the currently trending https://huggingface.co/TheBloke/Manticore-13B-GGML https://huggingface.co/TheBloke/Manticore-13B-GGML You can download it directly from oobabooga interface overall i have found gptx-4-alpaca to be pretty good. None of them are comparable to chatGPT of course because they are smaller, but they are still great
toonyman2020 3y ago
Nothing
deleted 3y ago
[deleted]

22 points by behnamoh 3y ago

Are there even any? I think all the big players censor because they're afraid of the headlines "major AI product used to do <bad thing>". Perhaps llama considering it can be self hosted?

Bran_son 3y ago
> "major AI product used to do* <bad thing>" *say
- wkat4242 3y ago
  I was thinking more about it helping people doing something bad, like write malware. In fact I expect the phishers will have a field day with this. I expect phishing to become a lot more targeted and accurate in the near future. And much harder to detect.

cratermoon 3y ago

What sort of censoring are you concerned about? What's excluded from ChatGPT that you want to use?

porkbeer 3y ago
Not op, but working on network code it suddenly refused asserting it could not help me make 'hacking tools', which was not the case. Furthermore, even if it was, those tools are legal and useful. Unwanted censorship abounds.

tikkun 3y ago

https://www.reddit.com/r/LocalLLaMA/wiki/models/ https://www.reddit.com/r/LocalLLaMA/wiki/models/ https://chat.lmsys.org/?arena https://chat.lmsys.org/?arena (Then click Leaderboard)

alpark3 3y ago

There's a bunch of LLaMA instruction-tuned variants on huggingface and new ones are coming out every day. I personally had the best experience with GPT4-x-vicuna: https://huggingface.co/NousResearch/gpt4-x-vicuna-13b https://huggingface.co/NousResearch/gpt4-x-vicuna-13b. There's more variants, and you can find information on them on https://www.reddit.com/r/LocalLLaMA https://www.reddit.com/r/LocalLLaMA. The best way for you to run the model is probably through https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp. This is a plain C/C++ implementation that can run LLMs pretty efficiently. It can run the LLaMA 13B variants at a pretty quick pace (~100 ms/token) on my M1 Pro macbook. I'd be happy to answer more questions.

behnamoh 3y ago
Thank you. As I'm new to this field, I have been grappling with some concepts like GGML vs GPTQ models, etc. It seems the GPTQ models only run on Linux, so your suggestion is right to use llama.cpp as that works with GGML and is compatible with M1 Macs as well. I had trouble running oobabooga on M1 Mac, something about Python arm64 vs x86_64... I didn't know about GPT4-x-Vicuna that you mentioned. Interesting to see that it's uncensored. I knew about Wizard-Vicuna-uncensored though. It seems like GPT4-x-Vicuna is similar.

juliensalinas 3y ago

You might want to try our ChatDolphin model on NLP Cloud that is very similar to Vicuna and uncensored: https://nlpcloud.com/home/playground/text-generation https://nlpcloud.com/home/playground/text-generation (select the ChatDolphin model at the top right). I hope it will be useful.

seydor 3y ago

I think this is the currently trending https://huggingface.co/TheBloke/Manticore-13B-GGML https://huggingface.co/TheBloke/Manticore-13B-GGML You can download it directly from oobabooga interface overall i have found gptx-4-alpaca to be pretty good. None of them are comparable to chatGPT of course because they are smaller, but they are still great

toonyman2020 3y ago

Nothing

deleted 3y ago

[deleted]