When you give chardet text in a 1-byte encoding, it sometimes ends up >99% confident that it's in ISO-8859-2. Empirically, it's not in ISO-8859-2. I think the

When you give chardet text in a 1-byte encoding, it sometimes ends up >99% confident that it's in ISO-8859-2. Empirically, it's not in ISO-8859-2. I think the problem here is that chardet is built on the assumption that "encoding detection is language detection" (from its docs). This assumption is necessary, and basically correct, when distinguishing Japanese encodings from Chinese encodings. It's even pretty much taken as a given that you can't have Japanese and Chinese text in the same document without contortions that most developers are unwilling to go through. But European languages and encodings are much more intermixed than that. One document may contain multiple European languages, and these languages may be written outside of their traditional encoding. I wouldn't know how to fix the European languages without damaging chardet's clear success at distinguishing East Asian encodings.