If you think about the data they are trained on, they don't see a lot of examples of multi-step plans. Given they are trained to see how concepts (ie, high dime

If you think about the data they are trained on, they don't see a lot of examples of multi-step plans. Given they are trained to see how concepts (ie, high dimensional vectors) fit together, they aren't going to perform well without a lot of examples of the reasoning required. They'll get there eventually, with synthetic data, good descriptions of goals followed by code written to implement it, etc.