4 ms·

Encoding seems to have gotten you in some cases: Aellig Pentti apparently lives in "D�rflingen". The website of the canton of Schaffhausen (sh.ch) uses ISO-885

Encoding seems to have gotten you in some cases: Aellig Pentti apparently lives in "D�rflingen". The website of the canton of Schaffhausen (sh.ch) uses ISO-8859-1, you do have to check the Content-Type header and/or the respective meta tag. Not everyone uses UTF-8 in 2017, it seems. You may also be interested in TERMDAT[1], maintained by the Federal Chancellery. It's a "specialist vocabulary in the Federal Administration"[2]. That should help you keep all the translations in line with what's used at a federal level, including English. They do have entries for things like "Kantonsrat", too, even though that's on a cantonal level. [1] https://www.termdat.bk.admin.ch/Search/Search https://www.termdat.bk.admin.ch/Search/Search [2] https://www.bk.admin.ch/bk/en/home/dokumentation/languages/termdat.html https://www.bk.admin.ch/bk/en/home/dokumentation/languages/t...

snowpanda 9y ago
Does that mean that the encoding of the browser visiting the page (or the server doing the scraping in this case) get ignored? I always thought it was the browser that set the encoding, come to think of it, not sure why I thought that.
- mateuszf 9y ago
  Browsers fall back to default encoding if the page doesn't specify encoding, or the encoding is not supported by browser.
  - snowpanda 9y ago
    Got it! Thanks for explaining.
faebi 9y ago
Uh, that's an obvious mistake. I fixed it now, so it should be correct somewhen after the next deployment and parsing of Schaffhausen. Thanks for the link to Termdat. I always felt very unsecure using any of those google translations I found.