Also you need to watch out for Unicode control characters messing everything up! Certain characters (up to you to figure out which) should actually be stripped

Also you need to watch out for Unicode control characters messing everything up! Certain characters (up to you to figure out which) should actually be stripped as they have no useful function for Western languages...