3 ms·
Around the year 2012 I got caught in a storm of synchronicities. I was led there through a bunch of things and ideas that happened in my life at that time. I fo
by blatant303 4y ago
Around the year 2012 I got caught in a storm of synchronicities. I was led there through a bunch of things and ideas that happened in my life at that time. I found some "strange attractors" (looks like it, I don't have the rigorous phase space characterizations, nor the knowledge to do it). Pick one language. Find two frequency lists. Remove words that aren't present in both and establish ranks (Or establish ranks then remove words that are not share, the order is critical, it was a long time ago and my memories have faded). Then do as if you were plotting a Zipf distribution but instead of comparing rank against frequency, compare each rank with (absolute) distance to the rank in other frequency list. You observe some structures merging amid a mist of points and continuity lines emerge. Because some frequencies come multiple times, the order of the list is partial but the plot demands total order anyway. There is some arbitrary ordering to do, so randomize those choices and make the seed vary: the points in the cloud change, but the metastable structure remains. Change your sorting algorithm, the shape of the structure changes. It remains (meta)stable.
Around the same time I play a philosophical game with a friend. Pivot subjects and nouns around their verb and observe. Don't say "I smoke a cigarette" but say "the cigarette smokes me". It often makes sense. And not just because the verb meaning implies the subject and object are naturally interchangeable. It creates meaning figuratively. I start envisioning a generalized commutation operation for linguistics (was studying this field at the time) that would not just be a tool to probe the structure of meaning. It would be its very foundation. The commutation would be like a geometric pivot: it's continuous. I sketch ideas about mapping the space of these commutation that create meaning figuratively, even oracularly. And I have that picture in mind that I can now convey by evoking scales weighting scales ... weighting the scales they sit on. I need a "fractal" byte, where each bit can be seen as a sub-byte, ad-infinitum, and operate computations at every scale at the same time. That's when it striked me what I needed was a quantum bit of some sort. At this point I have no interest in QM, it's just that I have that sudden realization that I need that stuff I read about in pop science magazines. It's as if the quantum came to me, not the other way around. Saying this now that I introduced that idea of linguistic pivot may make you smile. But it was the bread butter of my life at that time, it was the consubstantial mud at the bottom of synchronicity pit I was at the bottom of. Anyway it's not like I was coming up with a new idea, a representation of something (sketchy or not). No it was about incarnating that very idea, discovering the element that motivated your search in the first place. Imagine: a theory of how ideas emerge in theoreticians was emerging in me. It's everywhere in fact. Einstein elaborated a philosophical relativity theory with a "bro" when he was younger. Heisenberg too. There is some will for eternal return a need to close his inner loop in Strogatz when he concludes his chaos theory popularization book by saying sync may even explain how he wrote that book. Ditto with that woman quanta magazine interviewed about her work around geometrical forms whose interaction in a system make the entropy decrease. She says her objects of study are at play in the chaos that is her department as she oversees 40 phd students. This is what I call incarnation.
The story continues: 2012. Start studying computer science. Math teacher is a chaos theorician. He introduces himself and presents his main contribution to science. He draws on the blackboard what I would draw if I had to schematize those Zipfian pseudo-attractors I was trying to capture at that time. Incarnation strikes again, yet another synchronicity to add to the list. I thought I had caught an attractor, and now it seemed as if it was the the attractor that had caught me. Nonetheless nothing came out with my interaction with that researcher. I kept the secret of my formula (explained above), he thought I was spooky.
Some 10 years after the facts what can I tell ? Quantum linguistics is a booming field and there are people running question answering algorithms, on quantum hardware, with quantum native theories of language. The dude behind this says "language is quantum native". His master, Aerts, has views that goes along the line of "quantum physics is in fact a quantum linguistics construct". I'm exaggerating, but just a bit. Concretely, what do I have ? Nothing but juxtaposition and future-proves-past kind of non-points. Like this:
2019
https://deepai.org/publication/the-role-of-grammar-in-transition-probabilities-of-subsequent-words-in-english-text https://deepai.org/publication/the-role-of-grammar-in-transi...
> Sentence formation is a highly structured, history-dependent, and sample-space reducing (SSR) process. While the first word in a sentence can be chosen from the entire vocabulary, typically, the freedom of choosing subsequent words gets more and more constrained by grammar and context, as the sentence progresses. This sample-space reducing property offers a natural explanation of Zipf's law in word frequencies, however, it fails to capture the structure of the word-to-word transition probability matrices of English text. Here we adopt the view that grammatical constraints (such as subject--predicate--object) locally re-order the word order in sentences that are sampled with a SSR word generation process. We demonstrate that superimposing grammatical structure -- as a local word re-ordering (permutation) process -- on a sample-space reducing process is sufficient to explain both, word frequencies and word-to-word transition probabilities. We compare the quality of the grammatically ordered SSR model in reproducing several test statistics of real texts with other text generation models, such as the Bernoulli model, the Simon model, and the Monkey typewriting model.
- blatant303 4y agoWhat a coincidence, isn't it ? I like this one too: huh, wait I found a fresh one while digging some material I couldn't find again. I think I found it at the very beginning of a paper by Coecke or the Iranian woman behind discocat. They mentioned Zipf, frequencies of frequencies inside frequency dictionary and partial order and how it was related to Bose Einstein condensates (where individual particle act as one ... incarnation, incarnation). Anyway I found something about that topic. Author: Aerts, Coecke's master. What a coincidence, I was just looking for anything relating zipf to Bose einstein in google scholar. https://www.mdpi.com/1099-4300/24/1/6 https://www.mdpi.com/1099-4300/24/1/6 Are Words the Quanta of Human Language? Extending the Domain of Quantum Cognition Abstract In previous research, we showed that ‘texts that tell a story’ exhibit a statistical structure that is not Maxwell–Boltzmann but Bose–Einstein. Our explanation is that this is due to the presence of ‘indistinguishability’ in human language as a result of the same words in different parts of the story being indistinguishable from one another, in much the same way that ’indistinguishability’ occurs in quantum mechanics, also there leading to the presence of Bose–Einstein rather than Maxwell–Boltzmann as a statistical structure. In the current article, we set out to provide an explanation for this Bose–Einstein statistics in human language. We show that it is the presence of ‘meaning’ in ‘texts that tell a story’ that gives rise to the lack of independence characteristic of Bose–Einstein, and provides conclusive evidence that ‘words can be considered the quanta of human language’, structurally similar to how ‘photons are the quanta of electromagnetic radiation’. Using several studies on entanglement from our Brussels research group, we also show, by introducing the von Neumann entropy for human language, that it is also the presence of ‘meaning’ in texts that makes the entropy of a total text smaller relative to the entropy of the words composing it. We explain how the new insights in this article fit in with the research domain called ‘quantum cognition’, where quantum probability models and quantum vector spaces are used in human cognition, and are also relevant to the use of quantum structures in information retrieval and natural language processing, and how they introduce ‘quantization’ and ‘Bose–Einstein statistics’ as relevant quantum effects there. Inspired by the conceptuality interpretation of quantum mechanics, and relying on the new insights, we put forward hypotheses about the nature of physical reality. In doing so, we note how this new type of decrease in entropy, and its explanation, may be important for the development of quantum thermodynamics. We likewise note how it can also give rise to an original explanatory picture of the nature of physical reality on the surface of planet Earth, in which human culture emerges as a reinforcing continuation of life. That's some seriously all-encompassing shit. Very mystical if you ask me. Anyway, this is a few sentences into the paper: 1. Introduction If we consider ‘a text that tells a story’, then the same words can be interchanged within the text without changing anything about the story told by the text. Let us demonstrate what we mean by using a concrete text which we call the ‘Example Text’ It mists over the flanks of the hillside. In a few hours the climbing sun will dispel the haze. The pine trees are slender against the horizon. The animal saunters slowly down toward the great river. Before reaching the water, the animal looks into the distance and lets its proud sound reverberate across the valley. The animal continues its way through the young grass to the riverbank where it will enjoy its favorite food. From the small grove of trees growing a little further along the riverbank, another animal appears, surveying the panorama. We have underlined the four occurrences of the word Animal in the ‘Example Text’, and it is indeed evident that we can interchange these four words Animal with each other, and that this will not change the text as a story in any possible way (we will denote ‘words’ in italics and with an initial capital letter like we have denoted ‘concepts’ in our earlier works). Herein, ‘a text representing a story’ behaves differently from ‘a collection of macroscopic physical objects representing a landscape’ in physical reality. Indeed, let us now consider the physical landscape of ‘the animal sauntering down the hillside and the other animal appearing from the grove of trees along the riverbank’. If we swap these two animals in the physical landscape, this landscape will change essentially. Uncanny, I told you