That's very true. I thought about speaking more to that issue but the post was already longer than I wanted. You might find this short analysis interesting. h

That's very true. I thought about speaking more to that issue but the post was already longer than I wanted. You might find this short analysis interesting. https://www.arnaldur.be/experimenting/with/large-language-models-1 https://www.arnaldur.be/experimenting/with/large-language-mo... Here I do an exhaustive analysis of a range of simple math questions. I then visualize the output so you can see the failures. I do contend though that the tikz question mentioned in the post can't possibly be wholly represented in the training data. There is of course tikz code on the internet but it find it highly likely that the model extrapolated based on having seen my tikz code, and a bunch of other tikz code. I go further to contend that the extrapolation requires reasoning to achieve.