It's not perfect but it can reason, or solve many more situations than trained on. Here is a paper demonstrating that GPT-4 can combine up to 5 skills from a s

It's not perfect but it can reason, or solve many more situations than trained on. Here is a paper demonstrating that GPT-4 can combine up to 5 skills from a set of 100, effectively covering 100^5 tuples of skills, while only seeing much fewer combinations in training on a specific topic. > simple probability calculations indicate that GPT-4's reasonable performance on k=5 is suggestive of going beyond "stochastic parrot" behavior (Bender et al., 2021), i.e., it combines skills in ways that it had not seen during training https://arxiv.org/abs/2310.17567 https://arxiv.org/abs/2310.17567