2 ms·

^ Yes, edited my post! I've spent HOURS tweaking prompts and going back and forth with GPT3–4 to get more creative and interesting output, but it's not there ye

^ Yes, edited my post! I've spent HOURS tweaking prompts and going back and forth with GPT3–4 to get more creative and interesting output, but it's not there yet. This current generation will just never give you legitimately good song lyrics, let alone a game with an interesting and compelling mechanic.

redeux 4y ago
Having played around with the same scenario, I’ve come to the naive conclusion that the lack of creative output is because the current generation of GPT is only able to regurgitate and not create. This makes everything feel very derivative. On the other hand, if you act as the creative mind and use GPT to accelerate your output, it becomes more useful.
- SketchySeaBeast 4y ago
  Am I off base, or is "create" sort of amorphous in this context? It's already creating novel sentences and paragraphs. What is difference between that and real creation? Personally it seems to me that if you feed a statistical model of a ton of input it's going to feed back the average of that input, leading to uninspiring phrases. Regarding game creation, we'd need to tell it about game mechanics, and I have no idea how it'd determine what's interesting or how it would innovate.
  - turnsout 4y ago
    I think that's it—these models are definitely capable of creating output not seen in the input, which we would define as human "creativity," and they can even combine concepts in novel ways, which is loosely what we call "innovation." But they are quite biased to create plausible output, which severely restricts their ability to create something interesting. You can dial up the temperature, but this quickly pushes the output from "bland" to "totally unhinged."
Joeri 4y ago
Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are designed to do, which is to give the most likely next word. On the other hand, raising the temperature should allow unlikely sequences to be output, provided the model is trained on enough unlikely sequences as input. Also, most creative work does not require much creativity, so just a little human guidance may go a long way.

redeux 4y ago

Having played around with the same scenario, I’ve come to the naive conclusion that the lack of creative output is because the current generation of GPT is only able to regurgitate and not create. This makes everything feel very derivative. On the other hand, if you act as the creative mind and use GPT to accelerate your output, it becomes more useful.

SketchySeaBeast 4y ago
Am I off base, or is "create" sort of amorphous in this context? It's already creating novel sentences and paragraphs. What is difference between that and real creation? Personally it seems to me that if you feed a statistical model of a ton of input it's going to feed back the average of that input, leading to uninspiring phrases. Regarding game creation, we'd need to tell it about game mechanics, and I have no idea how it'd determine what's interesting or how it would innovate.
- turnsout 4y ago
  I think that's it—these models are definitely capable of creating output not seen in the input, which we would define as human "creativity," and they can even combine concepts in novel ways, which is loosely what we call "innovation." But they are quite biased to create plausible output, which severely restricts their ability to create something interesting. You can dial up the temperature, but this quickly pushes the output from "bland" to "totally unhinged."

Joeri 4y ago

Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are designed to do, which is to give the most likely next word. On the other hand, raising the temperature should allow unlikely sequences to be output, provided the model is trained on enough unlikely sequences as input. Also, most creative work does not require much creativity, so just a little human guidance may go a long way.