3 ms·

Am I right thinking that a self-hosted llama wouldn't have the kind restrictions ChatGPT has since it has no initial system prompt?

Kudos 2y ago
Many protections are baked into the models themselves.
dtquad 2y ago
All the self-hosted LLM and text-to-image models come with some restrictions trained into them [1]. However there are plenty of people who have made uncensored "forks" of these models where the restrictions have been "trained away" (mostly by fine-tuning). You can find plenty of uncensored LLM models here: https://ollama.com/library https://ollama.com/library [1]: I personally suspect that many LLMs are still trained on WebText, derivatives of WebText, or using synthetic data generated by LLMs trained on WebText. This might be why they feel so "censored": >WebText was generated by scraping only pages linked to by Reddit posts that had received at least three upvotes prior to December 2017. The corpus was subsequently cleaned The implications of so much AI trained on content upvoted by 2015-2017 redditors is not talked about enough.
- nubinetwork 2y ago
  > All the self-hosted [...] text-to-image models come with some restrictions trained into them https://github.com/huggingface/diffusers/issues/3422 https://github.com/huggingface/diffusers/issues/3422
- thrdbndndn 2y ago
  My to-go test for uncensoring is to ask the LLM to write erotic novel. But I haven't yet find any "uncensored" ones (on ollama) that works. Did I miss something? (On the contrary: when ChatGPT first came out, it was trivial to jailbreak it to make it write erotica.)
  - gjs278 2y ago
    [dead]
  - dtquad 2y ago
    Try the popular (pull count) dolphin models: https://ollama.com/library/dolphin-mistral https://ollama.com/library/dolphin-mistral
  - TomK32 2y ago
    I found that "Don't censor your answer" works as intended and my self-hosted llm happily delivers smut.
exe34 2y ago
It has a sanitised output. You might want to look for "abliterated" models, where the general performance might drop a bit but the guard-rails have been diminished.
nubinetwork 2y ago
That depends on the frontend, you can supply a system prompt if you want to... whether it follows it to the letter is another problem...

Kudos 2y ago

Many protections are baked into the models themselves.

dtquad 2y ago

All the self-hosted LLM and text-to-image models come with some restrictions trained into them [1]. However there are plenty of people who have made uncensored "forks" of these models where the restrictions have been "trained away" (mostly by fine-tuning). You can find plenty of uncensored LLM models here: https://ollama.com/library https://ollama.com/library [1]: I personally suspect that many LLMs are still trained on WebText, derivatives of WebText, or using synthetic data generated by LLMs trained on WebText. This might be why they feel so "censored": >WebText was generated by scraping only pages linked to by Reddit posts that had received at least three upvotes prior to December 2017. The corpus was subsequently cleaned The implications of so much AI trained on content upvoted by 2015-2017 redditors is not talked about enough.

nubinetwork 2y ago
> All the self-hosted [...] text-to-image models come with some restrictions trained into them https://github.com/huggingface/diffusers/issues/3422 https://github.com/huggingface/diffusers/issues/3422
thrdbndndn 2y ago
My to-go test for uncensoring is to ask the LLM to write erotic novel. But I haven't yet find any "uncensored" ones (on ollama) that works. Did I miss something? (On the contrary: when ChatGPT first came out, it was trivial to jailbreak it to make it write erotica.)
- gjs278 2y ago
  [dead]
- dtquad 2y ago
  Try the popular (pull count) dolphin models: https://ollama.com/library/dolphin-mistral https://ollama.com/library/dolphin-mistral
- TomK32 2y ago
  I found that "Don't censor your answer" works as intended and my self-hosted llm happily delivers smut.

exe34 2y ago

It has a sanitised output. You might want to look for "abliterated" models, where the general performance might drop a bit but the guard-rails have been diminished.

nubinetwork 2y ago

That depends on the frontend, you can supply a system prompt if you want to... whether it follows it to the letter is another problem...