2 ms·
> Conceptually it seems like the average of all human texts would be distinct from any users because it would blend word choices and idioms across regions That
by cesarb 2y ago
> Conceptually it seems like the average of all human texts would be distinct from any users because it would blend word choices and idioms across regions
That's only true in the aggregate. Within a single answer, LLMs will try to generate a word choice which is more likely _given the preceding word choices in that answer_, which should reduce the blending of idioms.
> where most of us are trained and reinforced in a particular region.
The life experience of most of us (at least here in HN) is wider than that. Someone who as a child visited every year their grandparents in two different regions of the country could have a blend of three sets of regional idioms, and that's before learning English (which adds another set of idioms from the teachers/textbooks) and getting on the Internet (which can add a lot of new idioms, from each community frequented online). And this is a simple example, many people know more than just two languages (each bringing their own peculiar idioms).
- brookst 2y agoWhile I agree that many people visit two regions of the same country, I think few of us would display word choice patterns reflecting the US, England, and Australia within a single piece. Could it happen? Sure. But LLMs won't have the bias towards likely combinations, except inasmuch as that's represented in training data.
- cesarb 2y ago> I think few of us would display word choice patterns reflecting the US, England, and Australia within a single piece. Someone who learned English mostly through books and the Internet could very well have such a mixture, since unlike native speakers of English, they don't have a strong bias towards one region or the other. You could even say that our "training data" (books and the Internet) for the English language was the same as these LLMs.