Exactly this. LLMs may do a passable job of architecture if there are many examples of high quality architecture similar to what you want to do in their trainin

Exactly this. LLMs may do a passable job of architecture if there are many examples of high quality architecture similar to what you want to do in their training set, but to introduce some novel stuff and they are clueless