5 ms·
I've seen lots of long prompt suggestions, however single words are fascinating, some words are extremely heavy, for example, we might assume 'topic' and 'subje
by tudorw 3y ago
I've seen lots of long prompt suggestions, however single words are fascinating, some words are extremely heavy, for example, we might assume 'topic' and 'subject' are somewhat interchangeable, but when I'm talking to an LLM swapping those words cause a huge change. Same with names, if you ask it to act like Dave, it's not some random personality, it's a distillation of every Dave it has encountered! I don't know how we could visualise and explore this but it's certainly interesting.
- sebzim4500 3y agoI wonder how much of this is due to mode collapse. With RLHF, there isn't really anything stopping it deciding that all Daves have a certain personality.
- kgwgk 3y agoThese are the Daves I know: https://m.youtube.com/watch?v=8nvzEqsZIGo https://m.youtube.com/watch?v=8nvzEqsZIGo
- bluenose69 3y agoSomehow, I needed that blast from the past!
- isaacfung 3y agoOn /r/midjourney subreddit there are posts like "the most stereotypical person in [state/country]", "what midjourney thinks professors look like based on their department". You can see some interesting biases in the training data. https://www.reddit.com/r/midjourney/top/?sort=top&t=year https://www.reddit.com/r/midjourney/top/?sort=top&t=year
- cubefox 3y agoI wouldn't use "bias" here. It's a very ambiguous term in machine learning.
- dafoex 3y agoNot sure what a better term would be... Just being more specific might help, like "bias in the training data"?
- cubefox 3y agoBut what does that mean? That the training distribution isn't representative of the population distribution, i.e. that it wasn't sampled IID? But the professors look pretty representative of real professors to me, so this doesn't sound very likely.
- 3np 3y agohttps://r.nf/r/midjourney/top/?sort=top&t=year https://r.nf/r/midjourney/top/?sort=top&t=year Don't feed the beast.
- roenxi 3y agoAlthough "not feeding the beast" doesn't inspire me much, it is notable that https://r.nf/ https://r.nf/ can display images without using javascript!
- lamontcg 3y agohow is that still working after the api-ocalypse?
- 3np 3y agoSource is here for inspection. https://github.com/libreddit/libreddit https://github.com/libreddit/libreddit You can self-host it as well.