For a temperature of 0, the highest probability token is predicted for each step. So “my favorite animal is” will end with “a dog” every time. With higher temp

For a temperature of 0, the highest probability token is predicted for each step. So “my favorite animal is” will end with “a dog” every time. With higher temperatures, lower probability tokens are sometimes chosen. “my favorite animal is” might end with “a giraffe” or “a deer”.