3 ms·
Just curious. What languages (human languages) were used in the training data set of GPT3? Is it trained only on English texts and grammar, or is it transcendin
by srg0 6y ago
Just curious. What languages (human languages) were used in the training data set of GPT3? Is it trained only on English texts and grammar, or is it transcending language barriers?
- supermatt 6y agoThe vast majority (>93%) is English (by document): https://github.com/openai/gpt-3/blob/master/dataset_statistics/languages_by_document_count.csv https://github.com/openai/gpt-3/blob/master/dataset_statisti...