The bulk of the GPT-4 training was concluded back in 2021, before the billions of dollars thrown at them by Microsoft. It's notable that the scale, design, and

The bulk of the GPT-4 training was concluded back in 2021, before the billions of dollars thrown at them by Microsoft. It's notable that the scale, design, and architecture of GPT-4 is a closely guarded trade secret of "Open"AI. This strongly hints at some critical discovery, some new technique, or some aspect dialed up to 11. Whatever it is, the competition hasn't figured it out, or managed to copy it.