5 ms·
Well, yes, adding noise increases the fractal dimension of a signal. "Shannon entropy" is noise. "Lempel-Ziv complexity" is "how long is the zip file".
by Animats 5y ago
Well, yes, adding noise increases the fractal dimension of a signal.
"Shannon entropy" is noise.
"Lempel-Ziv complexity" is "how long is the zip file".
- TenJack 5y agoInteresting. What do you mean by zip file?
- Animats 5y agoLempel-Ziv compression is used by some file compression utilities.[1] The ratio of original size to compressed size is essentially the Lempel-Ziv complexity. If you compress a file of AAAAAAAA..., you will get a very small file, and a low complexity. If you compress a file of random numbers, the file will not compress much, if at all, and you get a high complexity. "Lempel-Ziv complexity is the number of different sub-strings (or sub-words) encountered as the binary sequence is viewed as a stream (from left to right)"[2] This leads to a compression algorithm. [1] https://en.wikipedia.org/wiki/Lempel%E2%80%93Ziv%E2%80%93Welch https://en.wikipedia.org/wiki/Lempel%E2%80%93Ziv%E2%80%93Wel... [2] https://en.wikipedia.org/wiki/Lempel-Ziv_complexity https://en.wikipedia.org/wiki/Lempel-Ziv_complexity
- dorkmind 5y agoDoes listening to white noise increase the fractal dimension the same way as drugs?
- dr_dshiv 5y agoI thought Shannon entropy described the amount of information content in a message; its uncertainty or surprise. Why would it be noise?
- sritchie 5y agoAdding one random bit increases the entropy by a bit because there are now two possible messages - your message with a 0 or with a 1. Add a bunch of noise and you add a bunch of bits; entropy is average bits per message.
- Animats 5y agoSee Shannon's original paper, "Communication in the presence of noise".[1] In that view, where the goal is to reproduce the original signal, noise and information are not distinguished, because they look the same on the channel. Both "increase the fractal dimension". Adding noise will make a lossless compression of something much larger. Go add some noise to a simple picture in Photoshop, then export in some lossless compressed format, like .png. Now, lossy compression algorithms, such as JPEG, MP3, and almost all video compressors, are different. They have some model of what the content is "supposed to be like", and fit to that model. This works badly for content that does not fit the model, such as the mess JPEG makes of hard edges. The original author referenced Shannon. The tests he's running use signals from which he cannot extract meaning, so he can only extract the statistics you can compute from a signal you do not understand. There are other tests for "is it signal or is it noise" - looking at the spectrum, autocorrelation to look for repetition (they did some of that), correlation with other signals, and such - but "fractal dimension" isn't one of them. [1] https://course.ccs.neu.edu/csg250/ShannonNoise.pdf https://course.ccs.neu.edu/csg250/ShannonNoise.pdf
- motohagiography 5y agoThis is an important description, as when you think of a chemical creating impairment, it is essentially adding noise to signals in your brain, and a lot of the geometric and fractal artifacts we see resemble noise artifacts you would get from interfering with other analogue signals. Given your brain takes sensory signal input and coheres it, impairing that ability is going to create signals-based feedback that is described in information theory and signal processing, which if there is any periodic sampling going on on the coherance layer, you're going to get shape artifacts that are a function of that period. It's essentially 1/f noise and the experience of "more" information in a hallucinatory state is really just noisy information, like feedback on a TV. (It implies your brain has a clock cycle, and probably something like an NTP service.) Imagine your TV had worked perfectly for your entire life and the first time you experienced its signal was bad, but you didn't realize there was a world in which that signal could not exist, so it would be totally mind blowing and you might experience it as a rift in reality. It would demand the question, if the people on TV aren't the substrate of our shared reality, and they are only representations transmitted by signals our minds are cohering, what else isn't necessarily real? You'd tell other people that you had an experience where there is something else, a true substrate of reality where the televisions weren't coherent and real, which seems impossible, but if you've experienced it, you know. Suddenly, the televisions and they things they say are fallible, but there is still a you without them, and one that is not bound to the identity you see reflected in what they broadcast and tell you, because when the TV signal fed back on itself or echoed with delay, now you know there is something behind it all. It seems profound, but it's really just the first time your TV didn't work because something had impaired the signal. This is what I think hallucinogens are: noise on your sensory channels that reminds you the signals you use to cohere your experience exist in a substrate, which is just a mundane fact and necessarily physically true, and "you" are more than what your manage to cohere into a narrative from your sensory input. Some people believe a substrate or perception of something "else" is inconcievable because they have never experienced jitter in their coherence cycles, and once you do it seems like a really big deal, but really, it's not, and most of us just go back to chopping wood and carrying water.
- saiya-jin 5y agoFor me the (rather strong) trips from mushrooms showed me how some part of the brain (not sure which one though) is very good at interpolating bits and pieces of reality when there is no longer strong coming in via our senses. Its a blurry picture of reality, but the blur isn't the loss of detail but rather its fractalization (which in the end is the opposite of it). The harder the trip the less real-world signal and more brains's interpolation. We all have highly unique brains so although the principles are the same (fractals in visual and in mind, strange colors, mixing senses etc.) we all have such a unique take on it. And since the same brain is just guessing and smoothing input, and the one processing the guesses, its guesses are so 'self-compatible' that it can literally make its own feedback loops (I had it multiple times, when tripping with closed eyes I began wandering further and further away on a very consistent interconnected trip). Its so strange. I can remember those trips so well, but the 'enhanced' version of it is simply too vast for my normal brain to grok. Just partial projections like 3d into 2d that don't give full picture or don't make much sense.
- Gravityloss 5y agoYou can look at the EEG spectrogram or calculate its spectral entropy. When you think hard, it resembles white noise and has high entropy. If you close your eyes and relax, it gets more regular and entropy goes down. I've done this myself. And we've known about alpha and delta waves etc for more than a century. When you fall asleep, the signal goes more towards a sine wave, ie less entropy. Many of these complexity or information content metrics work in similar ways. You can even turn EEG recordings from medical operations with anesthesia to a sound and listen to them. The frequencies are of course very low so you must speed it up. You can clearly say when the person fell asleep. A waterfall turns into a hum. It makes sense, if you're making measurements of a complex system, of course white noise like results are more probable if there's actually something significant going on, than a simple sine wave. Or picture the modem calling sound. The low data rates are simple waves but the high data rate resembles white noise.