There are many curves. It's a series of sigmoids. There are many innovations to keep up with the expected constant performance increases and demand. They start

There are many curves. It's a series of sigmoids. There are many innovations to keep up with the expected constant performance increases and demand. They started running out of data, then curated it, then spent more time on inference. There are many small and large innovations that continue to improve performance as each improvement gets implemented and maximized and the gains flatten out and then increase again. Some are using giant SRAM chips. They will then connect them with optics. When that doesn't keep up with demand, probably memristors or something will be scaled to be the next paradigm. Look at the massive improvements made by the DeepSeek team to the open source SOTA recently.