3 ms·
We just to joke at NetApp that the Oil and Gas industry had the best compression algorithm, it could compress 100TB of seismic imaging data into a single bit {o
by ChuckMcM 11y ago
We just to joke at NetApp that the Oil and Gas industry had the best compression algorithm, it could compress 100TB of seismic imaging data into a single bit {oil / no-oil } :-)
I created a theoretical compressor which I haven't yet been able to implement which uses the fact that every sequence of bits appears in pi somewhere, so my compressor would just return the digit offset and the length of data. I keep looking for a source for all the digits of pi though, have yet to find it.
- digital_ins 11y agowhy not just create an online API for this? Sequences that are not yet "found" would go uncompressed, and as time goes by and internet speeds get faster and computing power gets cheaper, more sequences will be "found" for reference in that API and the algorithm will keep getting better. Alternatively, you could release a program that comes with an already long sequence of the decimal section of PI and connects regularly to the internet to download more digits (you could even run the computation & API on a google compute / amazon ec2 instance to keep costs low)
- komon 11y agoAfter having experimented a bit in high school with ideas for compression algorithms like this, I can tell you that one of the problems you'd run into is that you may have to look so deep into pi that the offset may actually take the same number of bits (or even more bits) than the sequence you're trying to find.
- ChuckMcM 11y agoIf you're up for it there is some great number theoretic work to be had in that statement :-). Given a sequence of digits X, P{X} E {Offset n .. Offset p} ? len{Offset n} > len{X}
- simon_acca 11y agoYou might find PiFs interesting: https://github.com/philipl/pifs https://github.com/philipl/pifs P.s. As the author states in issue #2, "the release date of pifs is an important part of understanding what's going on" ;)
- ChuckMcM 11y agoI really like that one too :-) Apparently there was a scam to sell a data set of all the US social security numbers, and the "decompressor" was just computing progressive digits of pi and printing them in xxx-yy-zzzz formatting.
- DanBC 11y agoOr the "Hacker tool" EVERY IP ADDRESS EVER released on P2P services. https://blort.org/~kgasso/images/how-to-catch-script-kiddies.gif https://blort.org/~kgasso/images/how-to-catch-script-kiddies... http://imgur.com/04sMAxd http://imgur.com/04sMAxd
- arh68 11y ago> which uses the fact that every sequence of bits appears in pi I don't think that's completely true yet, it's just incredibly likely. I don't mean you can't build the thing, you just can't quite prove it accepts all input; it could work in practice before it works in theory. Re: what komon said, if the offset dwarfs the input, perhaps you could find the offset of the offset, so on and so forth, keeping track of the # of indirections (until that number exceeds the input).