7 ms·
What do numbers look like?
- qwertyuiop_ 4y agoCan someone explain to me like I am 5 ?
- Jtsummers 4y agoConvert numbers to a vector space represented by their prime factors: 2 => [1 0 0 0...] 3 => [0 1 0 0...] 4 => [1 0 0 0...] And map that high dimensional space back down to two dimensions (using some technique I haven't dug into yet). Colors are assigned by some scheme, later images help to illustrate how the particular clusterings happen like one where primes are rendered in white.
- LanceH 4y agoThe whole thing seemed elaborately overly-formally-described and that just lessened the value of the cool graph.
- alanbernstein 4y ago"I have a friend who’s an artist and has sometimes taken a view which I don’t agree with very well. He’ll hold up a flower and say “look how beautiful it is,” and I’ll agree. Then he says “I as an artist can see how beautiful this is but you as a scientist take this all apart and it becomes a dull thing,” and I think that he’s kind of nutty. First of all, the beauty that he sees is available to other people and to me too, I believe. Although I may not be quite as refined aesthetically as he is … I can appreciate the beauty of a flower. At the same time, I see much more about the flower than he sees. I could imagine the cells in there, the complicated actions inside, which also have a beauty." - Richard Feynman
- tunnuz 4y agohttps://www.youtube.com/watch?v=ZbFM3rn4ldo https://www.youtube.com/watch?v=ZbFM3rn4ldo
- teo_zero 4y agoI dissent. The list of ingredients of the cake I'm eating doesn't lessen its exquisite taste.
- alanbernstein 4y agoother umap examples: https://umap-learn.readthedocs.io/en/latest/interactive_viz.html#umap-zoo https://umap-learn.readthedocs.io/en/latest/interactive_viz....
- O_H_E 4y agoahem .... explain like I am 0.5
- jerpint 4y agoNumbers are placed in an image according to their prime numbers
- sidlls 4y agoThis isn’t exactly it, but roughly: Make a vector space with primes as a basis (instead of “x, y, z,…” use “2, 3, 5, …”). For a number, find its prime factors. Make a vector and set elements corresponding to the prime factors of the number equal to 1. Apply some algorithm to map a high-dimensional (more than 2 elements) vector into a two dimensional image where color has some significance.
- 2-718-281-828 4y ago2 and 4 are mapped to the same vector?
- nerdponx 4y agoThe UMAP and tSNE algorithms both use fancy math to find a 2-dimensional representation of the data that tries to preserve local structure as much as possible. So blobs in the original space should be represented as blobs in the reduced space, but the relative positions of any two blobs in the reduced space is not meaningful.
- chrisshroba 4y agoNumbers that have similar prime factors are closer together.
- pubby 4y agoPrevious discussion: https://news.ycombinator.com/item?id=17817627 https://news.ycombinator.com/item?id=17817627
- adolph 4y agoThe gist has comments with some additional pretty graphs: https://gist.github.com/johnhw/dfc7b8b8519aac530ac97da226c17bd5 https://gist.github.com/johnhw/dfc7b8b8519aac530ac97da226c17...
- tunnuz 4y agoThis is one of the most beautiful things I have seen in 2022 on the Internet, and there were some very good contenders. This provokes in me an immediate sense of beauty, and I'm compelled to read and understand as much of it as I can. Thanks for sharing this, I'm fascinated and amazed.
- quakeguy 4y agoSadly merely artifacts .
- aamoscodes 4y agoArtifacts are a natural state of our universe
- glotchimo 4y agoCan’t those artifacts be beautiful in and of themselves? Whether or not this represents some deep reality about dimensions, it’s cool to see something like this emerge from a program when working with a bunch of numbers.
- expazl 4y agoSure, but that's no more interesting than a ML generated picture of a cat with a speech bubble saying "I can has numbers?"
- jerpint 4y agoWhat about the section that shows how dull random numbers are?
- nerdponx 4y agoI still think the t-SNE blobs are beautiful and interesting!
- maCDzP 4y agoIt reminds me of the first illustration of a cell I saw in school. Beautiful.
- superbatfish 4y agoAccording to Dmitry Kobak, some details in these figures are merely convergence artifacts, and no longer produced when using more recent versions of UMAP. https://twitter.com/hippopedoid/status/1318917878364672001?lang=en https://twitter.com/hippopedoid/status/1318917878364672001?l...
- teo_zero 4y agoYou mean, like the Mandelbrot set?
- 2-718-281-828 4y agowhat are you trying to say?
- teo_zero 4y agoThe structures that emerge from a series of transformations applied to an initial field (be it the natural numbers or the complex set), could be due to the transformations, or intrinsic of the underlying field. The parent comment stated that we're in the former case, i.e. we are seeing artifacts due to the transformation itself and we're not in front of some new properties of the numbers. It implied that this is a bad thing, or at least that's how I read that 'merely'. My (admittedly cryptic) reply was meant to show that similar results are worth attention as well, just like the Mandelbrot set, and should not be quickly dismissed as an unwanted effect.
- 2-718-281-828 4y agoso, your point is that the mandelbrot set isn't merely an artifact, if i understand you correctly.
- teo_zero 4y agoWait... I'm not sure where this conversation is going. I say that the beauty (or value or worthiness) of the pictures of the Mandelbrot set comes from the transformations we apply to uninteresting complex numbers. Similarly, the beauty of the pictures in the article may come from some hidden properties of the underlying prime numbers, or from the transformations themselves, and I don't think that either case would be better than the other. I said this in reply to a comment that seemingly stated "what a pity, these images are 'merely' due to the transformations". I was objecting to the tone of disappointment that I read in that message.
- clumsycomputer 4y agothis is great
- krick 4y agoI don't get it. So, do all these clusters mean anything at all? It feels like that should be telling us something eerily important about numbers. Granted, I don't really understand UMAP, but still, if it's any good for dimensionality reduction at all (and it appears to be), then clusters are clusters. This seems to have way too distinct structure to be essentially just a weird artifact of UMAP itself. Or is it?
- tuukkah 4y agoIt tells about the factorizations if anything, as that's the input dimensions they are using. If you haven't seen factorization diagrams, it's worth checking them out first: https://mathlesstraveled.com/factorization/ https://mathlesstraveled.com/factorization/ But visualisations can always deceive you into seeing something that's not there, e.g. correlation vs causation.
- krick 4y agoUh… what does it have to do with these "factorization diagrams"? Maybe I'm missing something, but I don't even see why are they "worth checking out". As far as I can see following your link, these are just arranging a number of dots into (pre-determined) shapes that are humanly recognizable. I.e., these are literally just some caveman technologies for writing a number before a more convenient (i.e. arabic) number system was invented. If anything, that combination of squares and triangles is less readable way to write 2²×3³×5, and it can be constructed only for "convenient" numbers (well, you can arrange into blocks 23×11×2 and 23×13×2 too, but good luck telling them apart). That's just silly, and tells me absolutely nothing about relationships between numbers. However, all numbers from 1 to 1 000 000 forming a distinct clusters when being mapped to 2 dimensions with UMAP… I don't know. It might be nothing (like a representation of something trivial, like an observation, that multiples of 100003 are less common than multiples of 3 in the set of first 1 000 000 integers), and all these clusters may just disappear (converge) as we go closer to infinity. But there's definitely something a bit eerie about the possibility of it not being "nothing". Normally, you wouldn't expect any patterns to form like that. Or, well, it may be more that a "nothing" but less than "interesting" for a mathematician — maybe there actually is some pattern that becomes more visible in this visualization, but it's already well-known among number theorists. I just have no idea, that's why I'm asking. It's just weird to see any clustering at all here. (And, yeah, BTW, there's no such thing as "correlation vs causation" in number theory.)
- SeriousM 4y agoThis is based on our common 10-based number system. I wonder how this would look in a 12-based system!
- teo_zero 4y agoI don't read anything suggesting that. Primes are primes in whichever base.
- eximius 4y agoI wonder why it was chosen to represent everything, well, not unit vectors, but nothing higher than 1. Why should 2 and 4 both be [1 0 ...] instead of [2 0 ...], etc?
- jerpint 4y agoIt might have to do with UMAP making dot products and assumptions about the inputs. If everything is 0s and 1s, the vectors will have a normal distribution of magnitudes (more or less). Otherwise the magnitudes will just explode and I don’t think UMAP will work.
- nerdponx 4y agoIt's also very common in general to use this "one-hot encoding" in statistics and machine learning. In many cases using all 2s or all -10s would produce the exact same result in theory, but with more work by the optimizing algorithm, possibly with adverse results as described above. It's easy to reason about mathematically, too. If the input vector is all 1s and 0s, it's easy to read off the result of multiplying that vector with another vector. Norms of binary vectors and dot products between binary vectors are super-easy, and have a nice correspondence with counting the appearances of elements. It also corresponds to an array of Boolean values which is conceptually appealing, because that's basically how it's constructed. With a couple of specific exceptions, there's little reason not to use all 1s.
- vanderZwan 4y agoThat kind of sounds like normalisation in other contexts ("hey let's just say lightspeed is 1, simplifies the equations"), is that a fair analogy to make?
- nerdponx 4y agoNormalization of that kind is also used in machine learning and statistics, but it's not quite the same thing. A related technique is "standardization", where are you subtract the mean and divide by the standard deviation, yielding unitless quantities of "standard deviations away from the mean". However this encoding technique is a bit more like choosing 1 and 0 to represent Boolean values in C: it's convenient, it's easy to reason about, it's mathematically simpler than any other option, and there's no compelling reason to choose anything else anyway. For binary variables in particular, you sometimes see people using -1 and 1 instead of 0 and 1, to get symmetry around 0. I think this was mostly only used for encoding the labels/outputs of SVM models, where it's mathematically appealing as representing two sides of a hyperplane. There are a handful of other schemes for encoding "categorical" or "nominal" data of this kind, used in certain statistical applications such as the design and analysis of experiments. These encoding schemes are called contrasts in the stats literature, because they emphasize the differences (the "constrasts") between categories.
- neslisah 4y agoIt's beautiful. When I think about infinite amount of numbers and dimensions with this representation, the form of the universe appeared on my eyes.
- tyronely 4y agoIf an artificial intelligence could open its pipes and vomit onto a newly-allocated two-dimensional array, I imagine its undigested bits would look very much like this.
- nerdponx 4y agoThis should be easily doable! Grab any model, pull off the output layer, run data through it to get a dataset of vector embeddings, and then run UMAP on it.
- jerpint 4y agoI wonder what would happen if you do the same thing but using an autoencoder instead of UMAP
- charmitro 4y agoThat's really really cool.
- deleted 4y ago[deleted]