2 ms·
Great work and I'm glad to see coverage of the Persian language! Upon inspecting the training dataset, I noticed almost all of the text is in "formal" Persian,
by behnamoh 3y ago
Great work and I'm glad to see coverage of the Persian language!
Upon inspecting the training dataset, I noticed almost all of the text is in "formal" Persian, which is fine if users want to talk to the model to write letters, website articles, etc., but what about "informal" Persian? Do you think the model could respond to users casual questions phrased like
به نظرت کدومو بخرم بهتره: این گوشیه که اندازه ی صفحه نمایشش ۶ اینچه یا اون یکی که یه کوچولو کوچیک تره ولی ۲ تومن ارزون تره؟
- haghiri 3y agoThis is another problem we may face in future. I guess we really need to launch a community where people can provide data for the future models.