4 ms·

I dont think people know many cool things you can do out of the box with text-generation-webui interface for chat models. With extensions for voice in/out, stab

I dont think people know many cool things you can do out of the box with text-generation-webui interface for chat models. With extensions for voice in/out, stable diffusion images in/out, long term memory and custom npc backstories its pretty much virtual reality in a box. Just some examples of things you can do. How about create a D&D (or any RPG) game, the NPC can be the dungeon master, creating monsters/loot and rendering pics in real time. Add additional NPC characters to join your party and actually take turns, you could play solo adventures. Even play via microphone, if the voice extension gets modified, you could have each character have its own voice via tts. The extensions are opensource to make anything you want, connect it to web or any service. Have the npc chat avatars trigger on actions. You can even train models, want to create a NPC based on a book? Feed it book series, tweak the personality, and you can chat with them, or make up new stories. The training model interface is included. Or for adults you could even create a virtual partner, or any type of NPC/avatar you want. Have them text you stable diffusion pics, chat with you on sms. etc. AND, the thing is, its out NOW on github with text-generation-webui. I was able to create a D&D dungeon master with stable diffusion in about 10 minutes. I did already have stable diffusion running thou, just enabled the api. I can't wait to see how this new amazing software can take off to form new ideas, games, technology.

kimburgess 4y ago
An SMS, email, or even physical mail only agent would be pretty interesting. With the socially accepted inherent limitations (text only, async, some level of misinterpretation expected) of those interfaces I'd wager it'd be possible to convincingly jump the uncanny valley today. Forcing to a comms path that's not just real-time chat affords a little more suspension of disbelief. Particularly with growing token counts, you can have a pen pal, virtual colleague, or friend to bounce ideas off, return to previous thoughts, and chat to in cases where a real one may not exist or be available. A little ELIZA-esque, but adaptable to different needs. My only concern is this would be be primed for misuse by people already experiencing isolation to further retreat miss opportunity to grow real social connections. Also, any semblance of privacy over those mediums would be a nightmare.
- IronWolve 4y ago
  People are already using it for dating sites and catfishing on twitter. I'm interested trying to make an RPG in the style of bards tale, generate the scenes for the game. Each game would be different. Cant get the client side voice gen working yet, but the online voice api works, but thats pay.

kimburgess 4y ago

An SMS, email, or even physical mail only agent would be pretty interesting. With the socially accepted inherent limitations (text only, async, some level of misinterpretation expected) of those interfaces I'd wager it'd be possible to convincingly jump the uncanny valley today. Forcing to a comms path that's not just real-time chat affords a little more suspension of disbelief. Particularly with growing token counts, you can have a pen pal, virtual colleague, or friend to bounce ideas off, return to previous thoughts, and chat to in cases where a real one may not exist or be available. A little ELIZA-esque, but adaptable to different needs. My only concern is this would be be primed for misuse by people already experiencing isolation to further retreat miss opportunity to grow real social connections. Also, any semblance of privacy over those mediums would be a nightmare.

IronWolve 4y ago
People are already using it for dating sites and catfishing on twitter. I'm interested trying to make an RPG in the style of bards tale, generate the scenes for the game. Each game would be different. Cant get the client side voice gen working yet, but the online voice api works, but thats pay.