If this is indeed the secret sauce behind GPT-4, I would expect it to be replicated in short order, hopefully in open source. Iteration on this more successful

If this is indeed the secret sauce behind GPT-4, I would expect it to be replicated in short order, hopefully in open source. Iteration on this more successful architecture will then proceed more rapidly since the architecture will be open for a wide spectrum of researchers rather than closed off within the bounds of one company.