Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are

Creativity is making unexpected connections, applying a twist that doesn’t logically follow from what came before. This is the opposite of what these models are designed to do, which is to give the most likely next word. On the other hand, raising the temperature should allow unlikely sequences to be output, provided the model is trained on enough unlikely sequences as input. Also, most creative work does not require much creativity, so just a little human guidance may go a long way.