I'm curious how much of "hardcoding" is in the chip? Can it have parts that don't need changing much and "offload" the rest into some sort of high-speed/bandwid

I'm curious how much of "hardcoding" is in the chip? Can it have parts that don't need changing much and "offload" the rest into some sort of high-speed/bandwidth interconnect? Will we reach a state where we have chips on which models can be "flashed" like CPU firmware? Or eventually will we reach a state where none of these tricks will be needed because like run-of-the mill Intel/AMD commodity CPUs, we will have full-power AI chips which will be part of an bigger/integrated mother-chip? Then what will happen to companies that do LLMs-as-a-service? Will they be forced to join and adapt becoming hybrid model+hardware shops? I'm not knowledgeable enough about hardware but throwing these random ideas out in hopes of thought-provoking responses to learn from.