3 ms·

Your BAD autogenerated asteroid clone. "Give it time" people will say, but how does one prompt ChatGPT to make a game fun, or a story actually interesting?

turnsout 4y ago
^ Yes, edited my post! I've spent HOURS tweaking prompts and going back and forth with GPT3–4 to get more creative and interesting output, but it's not there yet. This current generation will just never give you legitimately good song lyrics, let alone a game with an interesting and compelling mechanic.
- redeux 4y ago
  Having played around with the same scenario, I’ve come to the naive conclusion that the lack of creative output is because the current generation of GPT is only able to regurgitate and not create. This makes everything feel very derivative. On the other hand, if you act as the creative mind and use GPT to accelerate your output, it becomes more useful.
  - SketchySeaBeast 4y ago
    Am I off base, or is "create" sort of amorphous in this context? It's already creating novel sentences and paragraphs. What is difference between that and real creation? Personally it seems to me that if you feed a statistical model of a ton of input it's going to feed back the average of that input, leading to uninspiring phrases. Regarding game creation, we'd need to tell it about game mechanics, and I have no idea how it'd determine what's interesting or how it would innovate.
    - turnsout 4y ago
      I think that's it—these models are definitely capable of creating output not seen in the input, which we would define as human "creativity," and they can even combine concepts in novel ways, which is loosely what we call "innovation." But they are quite biased to create plausible output, which severely restricts their ability to create something interesting. You can dial up the temperature, but this quickly pushes the output from "bland" to "totally unhinged."
- Joeri 4y ago
  Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are designed to do, which is to give the most likely next word. On the other hand, raising the temperature should allow unlikely sequences to be output, provided the model is trained on enough unlikely sequences as input. Also, most creative work does not require much creativity, so just a little human guidance may go a long way.
wongarsu 4y ago
There are a lot of bad hobby games out there already. Telling human programmers "make this fun" doesn't reliably work, because being able to design good games is a skill with very little overlap with programming. If anything it has overlap with UX design, and we all know the stereotypes about programmer-built UIs. It's certainly possible to learn both skills, but taking away the need to be good at programming won't decrease the average quality of games made.
- SketchySeaBeast 4y ago
  I'm not saying humans consistently make good games, but we do know that humans can make good games. The question is can ChatGPT. If it's supposed to reach a the ranks of a general intelligence, it should be able to. I'm not sure how it can.
  - flangola7 4y ago
    Ask it to list verbosely step by step essential elements of what makes a game fun, then iterate upon each one of those.

turnsout 4y ago

^ Yes, edited my post! I've spent HOURS tweaking prompts and going back and forth with GPT3–4 to get more creative and interesting output, but it's not there yet. This current generation will just never give you legitimately good song lyrics, let alone a game with an interesting and compelling mechanic.

redeux 4y ago
Having played around with the same scenario, I’ve come to the naive conclusion that the lack of creative output is because the current generation of GPT is only able to regurgitate and not create. This makes everything feel very derivative. On the other hand, if you act as the creative mind and use GPT to accelerate your output, it becomes more useful.
- SketchySeaBeast 4y ago
  Am I off base, or is "create" sort of amorphous in this context? It's already creating novel sentences and paragraphs. What is difference between that and real creation? Personally it seems to me that if you feed a statistical model of a ton of input it's going to feed back the average of that input, leading to uninspiring phrases. Regarding game creation, we'd need to tell it about game mechanics, and I have no idea how it'd determine what's interesting or how it would innovate.
  - turnsout 4y ago
    I think that's it—these models are definitely capable of creating output not seen in the input, which we would define as human "creativity," and they can even combine concepts in novel ways, which is loosely what we call "innovation." But they are quite biased to create plausible output, which severely restricts their ability to create something interesting. You can dial up the temperature, but this quickly pushes the output from "bland" to "totally unhinged."
Joeri 4y ago
Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are designed to do, which is to give the most likely next word. On the other hand, raising the temperature should allow unlikely sequences to be output, provided the model is trained on enough unlikely sequences as input. Also, most creative work does not require much creativity, so just a little human guidance may go a long way.

wongarsu 4y ago

There are a lot of bad hobby games out there already. Telling human programmers "make this fun" doesn't reliably work, because being able to design good games is a skill with very little overlap with programming. If anything it has overlap with UX design, and we all know the stereotypes about programmer-built UIs. It's certainly possible to learn both skills, but taking away the need to be good at programming won't decrease the average quality of games made.

SketchySeaBeast 4y ago
I'm not saying humans consistently make good games, but we do know that humans can make good games. The question is can ChatGPT. If it's supposed to reach a the ranks of a general intelligence, it should be able to. I'm not sure how it can.
- flangola7 4y ago
  Ask it to list verbosely step by step essential elements of what makes a game fun, then iterate upon each one of those.