4 ms·

All base, “text-completion” models are uncensored, including Llama 3. You can make text-completion models behave like an uncensored “instruct” (chat) model simp

by d13 2y ago

All base, “text-completion” models are uncensored, including Llama 3. You can make text-completion models behave like an uncensored “instruct” (chat) model simply by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context, making sure to use the model’s exact prompt format. Once the model notices the pattern, it will continue like that. Surprisingly few people seem to know this. But, this is how chat models were created in the GPT3/2 era before instruct models became the norm.

davidzweig 2y ago
I was trying this with the original llama model. I guess the model didn't really know it's meant to be a 'knowledgeable ai assistant', but rather simulated chats it had seen. If you asked it, 'how to make brownies', it might reply, 'idk, can't you google it?'.
- d13 2y ago
  When you prime it with those initial 10-20 examples, the responses need to be in the style that you’d like it to respond to. You can use Claude or ChatGPT to help you write those. The model will then just continue on in that same style.
  - viraptor 2y ago
    Unfortunately those examples blow up the cost compared to just asking the question. It's a nice workaround, but not always feasible. (Unless everyone adopts context caching like deepseek and anthropic did)
rustcleaner 2y ago
I often force compliance out of Llama by starting Llama's response in a very compliant manner. My favorite use right now is for language translations. I finally feel comfortable browsing foreign languages, knowing Google isn't sitting there as a third party with a coherent view of my foreign language readings!
kenmacd 2y ago
> by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context Can you recommended examples (or a source of examples) that would have models act similar to the instruct models?

by d13 2y ago

davidzweig 2y ago

I was trying this with the original llama model. I guess the model didn't really know it's meant to be a 'knowledgeable ai assistant', but rather simulated chats it had seen. If you asked it, 'how to make brownies', it might reply, 'idk, can't you google it?'.

d13 2y ago
When you prime it with those initial 10-20 examples, the responses need to be in the style that you’d like it to respond to. You can use Claude or ChatGPT to help you write those. The model will then just continue on in that same style.
- viraptor 2y ago
  Unfortunately those examples blow up the cost compared to just asking the question. It's a nice workaround, but not always feasible. (Unless everyone adopts context caching like deepseek and anthropic did)

rustcleaner 2y ago

I often force compliance out of Llama by starting Llama's response in a very compliant manner. My favorite use right now is for language translations. I finally feel comfortable browsing foreign languages, knowing Google isn't sitting there as a third party with a coherent view of my foreign language readings!

kenmacd 2y ago

> by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context Can you recommended examples (or a source of examples) that would have models act similar to the instruct models?