4 ms·
A wonderful read. I know a little bit about frequency analysis and was surprised to see how straightforward its application was (in theory). I'm even more surpr
by danso 14y ago
A wonderful read. I know a little bit about frequency analysis and was surprised to see how straightforward its application was (in theory). I'm even more surprised that after a decade of Google, that this approach wouldn't be one of the first things tried out given the length of the text. As the OP describes, it was a chance encounter at a conference that machine learning was finally introduced into the problem. Until that point, the linguist had been trying in vain to decipher the text...is there still such a gap between the researchers and the computational experts who know how to implement solutions?
* to put it in a less-polite way: how the F else would you solve a problem like this, with non-computational methods?
- dizzystar 14y agoI suppose so. The article said Schaefer didn't have an internet connection. But how else? This is hard to say. How many people really worked in this one? The article doesn't say, but it does seem to suggest that not many people seen or heard of the Oculists or this piece of writing. I would think many other ciphers have been cracked in the pre-computer era that are of equal or similar difficulty of this one, but the difference is how many eyes were on it. This is an excellent article. When wired writes a good article, it is always amazing.
- Avshalom 14y ago>Until that point, the linguist had been trying in vain to decipher the text Well no, the linguist tried in vain to do frequency analysis by hand on ~88 symbols for ~100 pages for a couple months before saying "bugger this for a game of soldiers" and went on with her life. "She tried a few times to catalog the symbols, in hopes of figuring out how often each one appeared. This kind of frequency analysis is one of the most basic techniques for deciphering a coded alphabet. But after 40 or 50 symbols, she’d lose track. After a few months, Schaefer put the cipher on a shelf."
- dyselon 14y agoLike a lot of people that played Fez, I recently did some frequency analysis by hand, to crack the alphabet in that game. It was pretty tedious, and I messed up frequently. I wouldn't blame her for giving up after a few mistakes.
- _delirium 14y agoI don't think there's really such a gap in general. Classicists have been using computer-assisted frequency analysis for decades now to do things such as authorship attribution, and classics is otherwise a pretty staid and conservative field. I would guess this particular researcher just wasn't familiar with computational methods.