When the rules in the rule book are used as a cudgel to beat on native speakers of a language, it is the rules, and especially those using the rules in that way

When the rules in the rule book are used as a cudgel to beat on native speakers of a language, it is the rules, and especially those using the rules in that way, which are wrong. English has prestige dialects which conserve certain features, and others which are low status and don't. A phrase like "I done been doin it!" is grammatically regular, in a dialect of the language which you don't speak; it isn't the same thing as the mistakes a non-native speaker will make, at all, and you shouldn't treat it like it is.