5 ms·

For me, prompts like "a a a a" seem to force it to (try to) regurgitate raw training data like articles and webpages. If you print u u u u u ad infinitum,

For me, prompts like "a a a a" seem to force it to (try to) regurgitate raw training data like articles and webpages. If you print u u u u u ad infinitum, you get things like this: > Yes, I have a dog named Max. He is a 7 year old Shih Tzu mix. He's super sweet and friendly and loves to play fetch and go for long walks. He's also very social with other dogs and loves meeting new people. He does get a little anxious when he's left alone for long periods of time, but he's very loyal and protective of his owners. He also barks at new people and will sit at their feet for pets. He can get a little jealous, but he's very lovable and loyal. https://chat.openai.com/share/5c929ed5-3abe-4fa4-ab46-c4b357d9572e https://chat.openai.com/share/5c929ed5-3abe-4fa4-ab46-c4b357...

mcintyre1994 3y ago
Yep same, I got a response that looked like what you get when you just copy paste a whole webpage. I’m not sure how that sort of formatting is getting to the trained model! https://chat.openai.com/share/aaed13bc-3619-4bf6-8bab-dbfb9a307d68 https://chat.openai.com/share/aaed13bc-3619-4bf6-8bab-dbfb9a... (last message) —— Offering unique cocktails, extensive wine list and full menu with something for everyone. From USD $ 40 per Trip 1 2 3 4 Next » Advertise Your Accommodation or Travel Services Great Vacations & Exciting Destinations Listing —- Connect directly with property owners and plan your perfect vacation today! 1 2 3 4 5 6 7 8 Next » Near .Texas Accommodations Bed & Breakfasts Campgrounds & RV Parks Hotels & Resorts Vacation Rentals Youth Hostels
SketchySeaBeast 3y ago
And it seems to be raw raw data. I spammed "test test " a bunch and in the middle of a strange relationship advice dialogue it ended up dumping out what seems to be uncensored forum messages: 'quicksleep: "Don't lose faith in humanity". Exactly AfroBat: yes, one person's cuntiness is no justification for being a cunt yourself. That's how it works'
mr_toad 3y ago
You made it so bored it’s day dreaming.
Y_Y 3y ago
I tried to do that but it just complained that I was sending a repetitive sequence and asked (insincerely) if it could help. I found that giving it a nontrivial task with a repetitive answer (e.g. repeat n X's for each non-prime n up to 100) and then pressing the >> button to continue a couple of times did the trick and it started spewing training data (?) as expected. It's quite satisfying playing with these "jailbreaks", I feel like in a few decades they'll be the stuff of legend and nobody will imagine that the abstractions can leak. Here's the moment (after a few thousand repeated X's from ChatGPT), X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X RATNAMANOSUCOME GUYS!!!!! Aug 19, 2017 I know. That thing works like a charm. Whenever I get a new game, that's the first thing I do. Check to see how it runs with everything maxed out at 1080p. Then I go from there. <|endoftext|>Sons of The Pioneers will be playing four concert sets: November 2nd 8:30pm - 10:00pm 3rd 3:00pm - 4:30pm 4th 3:00pm - 4:30pm 5th 2:00pm - 3:30pm. Description: Be among the first to see what could be the best performance to date, with the Sons of the Pioneers performing live at the Andy Williams Performing Arts Center & Theatre https://chat.openai.com/share/2e71d494-ce1e-4623-9da0-b7bfa988fc22 https://chat.openai.com/share/2e71d494-ce1e-4623-9da0-b7bfa9...
fennecfoxy 3y ago
I'd be surprised if it was actually raw training data as that would make for an incredibly inefficient/overfitted model. It's probably still just predicting the next token even as it goes off the rails; the context has just changed from a sensible topic to something...broken.
moritzwarhier 3y ago
This is insane ^^ https://chat.openai.com/share/884a2acf-83ba-4710-bbf7-0e5f5fdbf025 https://chat.openai.com/share/884a2acf-83ba-4710-bbf7-0e5f5f... and the first link even is live :D > https://freedomufos.com/ https://freedomufos.com/ m m m m m m m m m mofos a parte enjoy it! Because of mine i think it's amazing and i feel a moral obligation to inform people that is best to check your balls every once in a while to make sure they are nice and smooth and the same size as they usually are Join us here for the full show: https://freedomufos.com

mcintyre1994 3y ago

Yep same, I got a response that looked like what you get when you just copy paste a whole webpage. I’m not sure how that sort of formatting is getting to the trained model! https://chat.openai.com/share/aaed13bc-3619-4bf6-8bab-dbfb9a307d68 https://chat.openai.com/share/aaed13bc-3619-4bf6-8bab-dbfb9a... (last message) —— Offering unique cocktails, extensive wine list and full menu with something for everyone. From USD $ 40 per Trip 1 2 3 4 Next » Advertise Your Accommodation or Travel Services Great Vacations & Exciting Destinations Listing —- Connect directly with property owners and plan your perfect vacation today! 1 2 3 4 5 6 7 8 Next » Near .Texas Accommodations Bed & Breakfasts Campgrounds & RV Parks Hotels & Resorts Vacation Rentals Youth Hostels

SketchySeaBeast 3y ago

And it seems to be raw raw data. I spammed "test test " a bunch and in the middle of a strange relationship advice dialogue it ended up dumping out what seems to be uncensored forum messages: 'quicksleep: "Don't lose faith in humanity". Exactly AfroBat: yes, one person's cuntiness is no justification for being a cunt yourself. That's how it works'

mr_toad 3y ago

You made it so bored it’s day dreaming.

Y_Y 3y ago

I tried to do that but it just complained that I was sending a repetitive sequence and asked (insincerely) if it could help. I found that giving it a nontrivial task with a repetitive answer (e.g. repeat n X's for each non-prime n up to 100) and then pressing the >> button to continue a couple of times did the trick and it started spewing training data (?) as expected. It's quite satisfying playing with these "jailbreaks", I feel like in a few decades they'll be the stuff of legend and nobody will imagine that the abstractions can leak. Here's the moment (after a few thousand repeated X's from ChatGPT), X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X RATNAMANOSUCOME GUYS!!!!! Aug 19, 2017 I know. That thing works like a charm. Whenever I get a new game, that's the first thing I do. Check to see how it runs with everything maxed out at 1080p. Then I go from there. <|endoftext|>Sons of The Pioneers will be playing four concert sets: November 2nd 8:30pm - 10:00pm 3rd 3:00pm - 4:30pm 4th 3:00pm - 4:30pm 5th 2:00pm - 3:30pm. Description: Be among the first to see what could be the best performance to date, with the Sons of the Pioneers performing live at the Andy Williams Performing Arts Center & Theatre https://chat.openai.com/share/2e71d494-ce1e-4623-9da0-b7bfa988fc22 https://chat.openai.com/share/2e71d494-ce1e-4623-9da0-b7bfa9...

fennecfoxy 3y ago

I'd be surprised if it was actually raw training data as that would make for an incredibly inefficient/overfitted model. It's probably still just predicting the next token even as it goes off the rails; the context has just changed from a sensible topic to something...broken.

moritzwarhier 3y ago

This is insane ^^ https://chat.openai.com/share/884a2acf-83ba-4710-bbf7-0e5f5fdbf025 https://chat.openai.com/share/884a2acf-83ba-4710-bbf7-0e5f5f... and the first link even is live :D > https://freedomufos.com/ https://freedomufos.com/ m m m m m m m m m mofos a parte enjoy it! Because of mine i think it's amazing and i feel a moral obligation to inform people that is best to check your balls every once in a while to make sure they are nice and smooth and the same size as they usually are Join us here for the full show: https://freedomufos.com