5 ms·
I'm probably talking out of my ass but I'm somewhat suspect of a cortex having straight up columns. I'm curious whether these are artifacts of the fact that lin
by adamnemecek 9y ago
I'm probably talking out of my ass but I'm somewhat suspect of a cortex having straight up columns. I'm curious whether these are artifacts of the fact that linear algebra seems to be the dominant algebra in ML/modeling of human perception. Recently I've been dipping my feet into geometric algebra which seems to be the superior algebra for just about anything you can think of (human perception but also like all of physics, Maxwell's 4 equations are reduced to a single equation in GA) and it's particularly better for reasoning about spaces which this seems to be all about.
And unlike linear algebra it actually makes sense (e.g. why is cross product only in three dimensions?, wtf are determinants esp. in the context of matrix division all about?).
This blog post introduces GA and talks about it's relationship to human perception.
https://slehar.wordpress.com/2014/03/18/clifford-algebra-a-visual-introduction/ https://slehar.wordpress.com/2014/03/18/clifford-algebra-a-v...
- gowld 9y agoLinear algebra is equivalent to geometric algebra so you wouldn't find columns less likely in GA. Also, GA is usually hyped by non-mathematicians -- people who don't understand that it's just an alternative notation that doesn't add much to linear algebra. > Clifford Algebra, a.k.a. Geometric Algebra, is a most extraordinary synergistic confluence of a diverse range of specialized mathematical fields > It is the very simplicity and generality of Clifford Algebra that confirms its “truth” kook alarms ringing
- adamnemecek 9y ago> Linear algebra is equivalent to geometric algebra That depends on your definition of equivalent. They have the same computational power but things make sense in one and less in the other. > Also, GA is usually hyped by non-mathematician What a loaded statement. > kook alarms ringing You aren't the first one to say it. Nonetheless, the author is a researcher at Harvard it seems http://cns-alumni.bu.edu/~slehar/Lehar.html http://cns-alumni.bu.edu/~slehar/Lehar.html Don't let the form fool you. You can also read any of the many books on the topic.
- gowld 9y ago> Research Fellow in Ophthalmology, Harvard University And I'm sure he's a fine opthalmologist. > I am an independent researcher with a novel theory of mind and brain, inspired by the observed properties of perception. These observations are confirmed by some peculiar anomalies in phenomenal perspective. The implications of these observations are that the foundational assumptions of neuroscience are fundamentally in error, and that an alternative paradigm of neurocomputation will have to be formulated to account for the properties of consciousness and perception. If it quacks like a quack...
- kkylin 9y agoMammalian cortex (well, in the species that have been studied closely) has both laminar and columnar structures. If you are interested in the biology side of things, take a look at http://hubel.med.harvard.edu/book/bcontex.htm Caveat: it's pretty old, and is probably not quite right in a number of ways. But IMHO still a reasonable lay-person's introduction to what we know about the organization of the early visual pathway. (Whether this has got anything to do with ML, I'm not in a position to say.)
- lamename 9y agoCortical columns exist [1]; think perpendicular to the surface of the cortex [2, 2nd image, or just image search "cortical column"]. This is due to the morphology of cortical neurons. My understanding is that a column can be thought of as a functional unit, and passing information across columns adds complexity. Of course biology is messy and there's tons of variation depending on which brain region you're looking at, but Visual Cortex was one of the earliest places this was observed. It gets complicated and detailed quickly, and I'm somewhat out of my element here. [1] https://en.wikipedia.org/wiki/Cortical_column https://en.wikipedia.org/wiki/Cortical_column [2] http://www.mbfbioscience.com/blog/2012/01/neurolucida-helps-florida-researchers-reconstruct-a-region-of-the-rat-brain/ http://www.mbfbioscience.com/blog/2012/01/neurolucida-helps-...
- SubiculumCode 9y agoThere are, of course lateral connections between columns, but the columns are very real. I dont see what geomettic algebra has to with it, as the grandparent suggests.
- adamnemecek 9y agoThey are performing spatial reasoning and GA is a better algebra for that.
- SubiculumCode 9y agoI mean I don't see why geometric algebra bears on the factual existence of column-like structure perpendicular to the cortical surface in real brains. Geometric algebra may bear on what those columns do, but it is not relevant to whether the columns exist. This is a matter of observing network wiring from brain preparations.
- kortex 9y agoI think it has something to do with the power of building hierarchical layers of abstraction, to make increasingly precise predictions about the world.
- wbl 9y agoWhat definition of linear algebra doesn't include the Clifford functor?
- madhadron 9y agoYou're confusing Gibbs-Heaviside vectors with linear algebra. Linear algebra is the study of linear spaces and linear operators between them. Endowing those spaces with a norm or a dot product is usually as far as linear algebra courses go.
- adamnemecek 9y agoAre you saying that cross product isn't a part of linear algebra?
- madhadron 9y agoI am. I suppose you could say that any linear space equipped with some product on it falls into linear algebra, in which case it would be, but an obscure corner at best. Its sole application is electromagnetism in a non-relativistic formulation. That's a hugely important application if you're a physicist, but compared to the number of applications of linear algebra it's basically negligible. The inner product is the only one usually taught in linear algebra, and that's because it's central to talking about representations of linear operators in bases.