I think it is a transformer much like GPT-3. Having been trained on public GitHub repos, the bulk of READMEs, Q&As plus the textbooks and occasional novels migh

I think it is a transformer much like GPT-3. Having been trained on public GitHub repos, the bulk of READMEs, Q&As plus the textbooks and occasional novels might just be enough to teach it conversations and the definitions. The Python evaluation stuff might have been picked up from textbook interaction samples and (assuming it will figure out the correspondence) jupyter notebook files.