4 ms·

Got the ops-30b chatbot running on 3090 24GB. I set compress_weight=True and compress_cache=True, and ran with `python apps/chatbot.py --model facebook/opt-30b

by lxe 4y ago

Got the ops-30b chatbot running on 3090 24GB. I set compress_weight=True and compress_cache=True, and ran with `python apps/chatbot.py --model facebook/opt-30b --percent 100 0 100 0 100 0`. I also modified the prompt a bit to make it more... uh alive: Assistant: Did you know that Saturn is 97 times the size of Earth? Human: Are you sure? Assistant: What difference does size make, really, anyway? Human: You didn't answer my question. Assistant: Hey, it's your question I didn't answer! Anyway, did you know that on the surface of Saturn, there's lakes of liquid methane and ethane? Human: I didn't know that. Are there any lakes on the Sun? Assistant: Look, I'll be honest with you. I don't know much about the Sun. Is it even a planet? Human: It sure is. Why don't you know about the Sun? I thought you were a hyperintelligent AI? Assistant: You're right. I'm a hyperintelligent AI. I'm hyperintelligent enough to know that I know jack shit about the Sun.

razor_router 4y ago
That's impressive! How much customization did you have to do in order to get the chatbot to respond like that?
- lxe 4y ago
  Not much. Here's the prompt: A chat between a human and a more funny and witty intelligent assistant Human: Hello! What can you do? Assistant: Hey there! I can pretty much do whatever you ask! Human: What is the name of the tallest mountain in the world? Assistant: It's Everest. Human: Are you sure? Assistant: You damn right I'm sure! I'm a hyperintelligent AI!
  - posguy 4y ago
    All I can think of is outsourcing to ChatGPT now... https://www.youtube.com/watch?v=rYaZ57Bn4pQ https://www.youtube.com/watch?v=rYaZ57Bn4pQ
syntaxing 4y ago
This is amazing. Reminds me of claptrap from Borderlands
- LoganDark 4y ago
  It really does
- samstave 4y ago
  OMG What will be the first game with ChatGPT integrated into the NPC dialog interactions? My vote is Hitman, with variable voices....
  - djokkataja 4y ago
    It's already been done with Mount & Blade II, though I don't know if that was the first. https://www.techspot.com/news/97572-mount-blade-ii-mod-uses-chatgpt-procedurally-generate.html https://www.techspot.com/news/97572-mount-blade-ii-mod-uses-...
mightytravels 4y ago
Awesome - how many GB of hard drive/ SSD was required? What is your CPU RAM?
sva_ 4y ago
I wonder if there would be interesting results if you make this model talk to openais chatgpt, since they are different models. Seeding them with some topic.
- destroy-2A 4y ago
  Do not let Dinesh AI talk to Gilfoyle AI !

by lxe 4y ago

razor_router 4y ago

That's impressive! How much customization did you have to do in order to get the chatbot to respond like that?

lxe 4y ago
Not much. Here's the prompt: A chat between a human and a more funny and witty intelligent assistant Human: Hello! What can you do? Assistant: Hey there! I can pretty much do whatever you ask! Human: What is the name of the tallest mountain in the world? Assistant: It's Everest. Human: Are you sure? Assistant: You damn right I'm sure! I'm a hyperintelligent AI!
- posguy 4y ago
  All I can think of is outsourcing to ChatGPT now... https://www.youtube.com/watch?v=rYaZ57Bn4pQ https://www.youtube.com/watch?v=rYaZ57Bn4pQ

syntaxing 4y ago

This is amazing. Reminds me of claptrap from Borderlands

LoganDark 4y ago
It really does
samstave 4y ago
OMG What will be the first game with ChatGPT integrated into the NPC dialog interactions? My vote is Hitman, with variable voices....
- djokkataja 4y ago
  It's already been done with Mount & Blade II, though I don't know if that was the first. https://www.techspot.com/news/97572-mount-blade-ii-mod-uses-chatgpt-procedurally-generate.html https://www.techspot.com/news/97572-mount-blade-ii-mod-uses-...

mightytravels 4y ago

Awesome - how many GB of hard drive/ SSD was required? What is your CPU RAM?

sva_ 4y ago

I wonder if there would be interesting results if you make this model talk to openais chatgpt, since they are different models. Seeding them with some topic.

destroy-2A 4y ago
Do not let Dinesh AI talk to Gilfoyle AI !