They did, but now there is GPT3 which is closed access API only and I'm not aware of any stated plans to publish that model. On the plus side, if their claims

They did, but now there is GPT3 which is closed access API only and I'm not aware of any stated plans to publish that model. On the plus side, if their claims about how GPT3 was constructed are truthful it should be possible for outside parties to reproduce it-- though at considerable cost.