4 ms·
Theres an IEEE paper by H. Zhang from 2008 where the author was surprised random open source java source code followed zipf law. It would be interesting to com
by VLM 11y ago
Theres an IEEE paper by H. Zhang from 2008 where the author was surprised random open source java source code followed zipf law.
It would be interesting to combine that paper's idea of analyzing source code with your idea of peculiar modes of thought and see if zipf still holds under those peculiar mental models for large enough code samples. For example does intermediate OCR API code follow zipf the same way as numerical analysis code, or some weird string theory code?
Going into the hard sci fi (or weird fantasy) arena of fictional writing, I think an elaborate yarn along the lines of ye olde fortune teller or program correctness prover or traveling salesman router, based on zipf and compression algos would make an entertaining story... "So back in the 22nd century when they proved 11 dimensional string theory was true because it was the only geometry where the DSL describing it followed zipf-law statistics, and everyone knows only real things that are true follow zipf therefore the simulation must be accurate..." I suppose the plot twist would be something along the lines of outright falsehood documents also follow zipf...