6 ms·
Show HN: Ragdoll Studio (fka Arthas.AI) is the FOSS alternative to character.ai
- isoprophlex 3y agoSo, this interacts with someone else's hosted model, or something open source you might host yourself. But these models are still more or less censored. What does it take to build something like this that is completely sexually unshackled, that can do explicit things? I guess simply a lot of training material and money?
- quantxx 3y agoSimple general purpose uncensored models without any specific dataset are already pretty good with that kind of stuff.
- isoprophlex 3y agoInteresting; would you have any specific recommendations for an intelligent (high parameter count? Something that can hold a conversation ...), uncensored, specific model that is able to do this?
- KronisLV 3y agoIf anyone is looking for a cloud option (e.g. don't have the hardware, just want to pay someone else to handle the compute while still writing about generally uncensored things like a violent RPG adventure or something explicit in the adult sense), then I guess NovelAI could fit the bill: https://novelai.net/ https://novelai.net/ I guess most people focus on their image generation which is pretty cool for anime characters and things like placeholder art (say, in gamedev), but their text generation options are also pretty nice and can be used either through their web UI, or something like SillyTavern: https://github.com/SillyTavern/SillyTavern https://github.com/SillyTavern/SillyTavern If you do want to run something locally and have the hardware, I think people discuss models in a variety of places, like https://old.reddit.com/r/LocalLLaMA/comments/16425mk/best_nsfw_model/ https://old.reddit.com/r/LocalLLaMA/comments/16425mk/best_ns... (quick search, was curious, NSFW discussion) and it seems like there's plenty of models on HuggingFace, though I haven't particularly looked into them. I will absolutely say that even when I was trying to run a general purpose chatbot LLM, it was kind of impressive how quickly things are moving ahead in regards to LLMs: all of these GGML, GGUF and other formats, being able to use even consumer GPUs (though I couldn't get ROCm working with my RX580) and experimental attempts like using Vulkan.
- gryfft 3y agohttps://huggingface.co/fhai50032/BeagleLake-7B-Toxic-GGUF https://huggingface.co/fhai50032/BeagleLake-7B-Toxic-GGUF This one works with GGUF-compatible llama.cpp wrappers like the fully-local, fully-private Layla app or the other examples tossed around. With some prompt tweaking it's capable of a broad variety of... tasks. This model is very compliant and doesn't tend to go to "I'm sorry, as a large language model..." type replies.
- meat_machine 3y agoI think most custom fine-tunes and merges on HuggingFace will do this unless they specifically mention it being censored. Even the lower param models have been surprisingly good, with relatively fast progress being made in the 7b and 11b models. My "daily driver" is Fimbulvetr v2 11b, surprisingly slapped together by an EMT. Kunoichi 7b seems to be a pretty popular model too. These can be run locally with as little as 8 GB free RAM (preferably VRAM) with an easy install solution like LMStudio or Faraday. You can generally find a lot of recommendations in places like SillyTavernAI or LocalLLaMa on reddit: https://old.reddit.com/r/SillyTavernAI/comments/1brig2n/which_model_is_the_most_unhinged_for_you/ https://old.reddit.com/r/SillyTavernAI/comments/1brig2n/whic...
- _akhe 3y agoRagdoll is based on RAG - the knowledge is scoped to documents you define, and is uncensored, even if the model you're using has censorship. For example, if you provided some raunchy URLs as Lara Croft's source of knowledge, you could have realistic conversations about the content there, however sexually unshackled they may be. To test it, I just searched for some known banned words in character.ai and tried them in character.ai. It refused to answer, tried to convince me to not talk about it, and even clarified there's a policy against these words, breaking the 4th wall. I asked the same thing to a character in Ragdoll and can confirm they will speak on it like any other knowledge you provide. Original RAG paper: https://arxiv.org/pdf/2005.11401.pdf https://arxiv.org/pdf/2005.11401.pdf Thanks for asking about this, I see this come up a lot on character.ai discussions elsewhere, and I'm going to do a NSFW case study about it soon!
- realfeel78 3y agoIt takes peeling yourself out of your gaming chair, getting a gym membership and trying to make something of your real life.
- deleted 3y ago[deleted]
- qznc 3y agoDownload ollama and use one of the dolphin models. You can literally do it in two commands: curl -fsSL https://ollama.com/install.sh | sh ollama run dolphin-phi That puts you into a chat with an uncensored LLM. "Phi" is the smallest model though.
- _akhe 3y agoJust wanted to add that ollama doesn't support text-to-image yet, ragdoll implements stable diffusion's txt2img separately. I tried that Phi one, it was very bad, not even close to ready for primetime. My favorites from ollama so far are mistral for most uses and alfred for highly instructional use cases. I can't even try some of them because of the requirements, but some of the apparently high-end ones I have tried just aren't good - unusably so. Mistral is pretty awesome, glad they are fully open.
- helloericsf 3y agoI don't quite understand how it's an open-source alternative to Character.AI. It seems like just a front-end for running vanilla open-source models, rather than something fundamentally different. Why do you need this while the OSS model chatbots are widely available on various platforms?
- dartos 3y agoWell… what do you think character AI is?
- _akhe 3y agoIt's a FOSS alternative because instead of using their online platform to make an account in order to interact with their characters, you instead download and run this source code without needing an account to interact with yours, and those in the community - even offline if you want. There's more to it than just chatting with AI models - these "ragdolls" are based on RAG so they are able to have distinct personalities and scoped knowledge. They can't leak info they don't know about, can't be censored from talking about things they do know about, and can be exported and shared with others on the community site. The model itself is more like the underlying engine, where the ragdoll is a specific persona that you can deploy to a variety of tasks (starting with just chat). I want to go beyond what character.ai is even dreaming of doing by making this into a creative suite for all things AI: Chat, storytelling, art & visual design, cinematography, CGI, music & sound effects, and so-on. It would be great to have an open-source character-focused tool for making stories, cinematics, films, music, etc. Here's an example that uses a ragdoll as an NPC in a game that has specific knowledge that the player can uncover in order to advance in the game: https://github.com/bennyschmidt/ragdoll-studio/tree/master/examples/game-npcs/oracles-tomb https://github.com/bennyschmidt/ragdoll-studio/tree/master/e... Thanks for the question, I will add a section on how these are fundamentally different from just chatting with ChatGPT.
- jowday 3y agoOut of curiosity: did the name change because of issues with Blizzard?
- randkyp 3y agoDoes this do RAG over the character's chat history too? That's something SillyTavern can also do with extensions, but I figured since your project already uses Llamaindex, this feature can be something that's already baked in from the get-go.
- _akhe 3y agoYep it can do CoT for ongoing conversations or to get to the bottom of something through back-and-forth. And you nailed it regarding llamaindex, they provide framework options: https://docs.llamaindex.ai/en/latest/examples/chat_engine/chat_engine_context/ https://docs.llamaindex.ai/en/latest/examples/chat_engine/ch... (perfect for HN with the Paul Graham example!) They even dabble in custom personalities with prompt mixins (example: You can chat with a PDF that will respond like Shakespeare), and if this part was more robust I would delegate to it instead of what I created with ragdoll's prompt prefixes. Turns out the hard part is not converting third-person to first-person. For ragdoll, the heavy lifting is more in the configuration and management of different personas, its multi-modality (of models), the Node & React libraries so that developers can use them in realistic applications... where the value llamaindex brings is its incredible indexing capabilities combined with a conversational query engine (why I chose llamaindex over langchain for this). Ragdoll picks up where llamaindex leaves off regarding personas. I love that SillyTavern says on their GitHub README: "On its own Tavern is useless, as it's just a user interface. You have to have access to an AI system backend that can act as the roleplay character." I want to avoid being a thin wrapper, and instead have that roleplay character aspect be central to what ragdoll does, so that it can be the de facto creative studio for any character-focused creative deliverable: A story, a film, music, games - so that a user can literally create films and music (and more) in this app like some kind of super Photoshop. I think to accomplish that, it cannot simply be a thin wrapper around an open model. It has to bring as much to the table as an ultra fine-tuned model would yet in seconds instead of years, and with the app- and community-level functionality needed (including being a free-to-use creator tool) to get people to actually build things with it.
- loa_in_ 3y agoI don't think a tavern is a place one goes to to make movies
- wslh 3y agoWhy there is no a video in the front page?
- pentagrama 3y agoSimilar to https://faraday.dev/ https://faraday.dev/ that also runs locally. I wish I can install on desktop like Faraday to try it.