3 ms·
Any tips you can give for like minded folks? Besides grimjim (checking it out).
by threecheese 2y ago
Any tips you can give for like minded folks? Besides grimjim (checking it out).
- wkat4242 2y agoWell you can use some jailbreak prompts but with cloud models it's a cat and mouse game as they constantly fix known jailbreaks. With local models this isn't a problem of course. But I prefer getting a fine-tune model so I don't have to cascade prompts. Not all uncensored models are great. Some return very sparse data or don't return the end tags sometimes so they keep hallucinating and never finish. If you import grimjim's model, make sure you use the complete modelfile from vanilla lama3.1, not just an empty modelfile. Because he doesn't provide one. This really helps setting the correct parameters so the above doesn't happen so much. But I have seen it happen with some official ollama models like wizard-vicuna and dolphin-llama. They come with modelfiles so they should be correct.