5 ms·

I have always absolutely hated this diagram and think it should go away. I have also never seen somebody who understands the content of the diagram share it as

I have always absolutely hated this diagram and think it should go away. I have also never seen somebody who understands the content of the diagram share it as a useful pedagogical tool. For example, with CNNs, you are building up feature activation volumes based on the entire previous layer. The edges between layer N only connects to two nodes in layer N-1. What are the nodes even supposed to represent? This is not how CNNs works. This explains nothing and is actually just confusing. This entire diagram should be re written using the block diagrams from the actual papers.

BiasRegularizer 7y ago
Also in the VAE diagram, the latent space appears to have the same dimensions as input and output.
Raphaellll 7y ago
My experience is that this is only shared by people on LinkedIn who have no clue what they are talking about.
- euroPoor 7y ago
  To add an anecdote: I’ve only seen it in professor’s labs before and have been looking for it for a long time.
acro 7y ago
To me the DCN picture looks ok, in convolution layer nodes receive input only from small area of the previous layer, in general this is true for convolution layers (kernels) and pooling layers. After that it has couple of fully connected layers where the connections go from every node to every node. Or have I misunderstood something in your comment?
mysterydip 7y ago
Do you know of a resource that has done the block diagram format? I want to understand more about NNs but all I see are node diagrams.
- sabalaba 7y ago
  Yes, go to scholar.google.com and search the name of the network. You’ll find the original paper (it will likely have many citations) which will describe the architecture in detail and have a useful diagram for you.
stared 7y ago
I agree that these diagrams are very abstract, verging on minimalistic data art. To a large extent, if you know what is going on, you don't need this diagram. If you don't - a diagram does not help. Vide "Simple diagrams of convoluted neural networks" (https://medium.com/inbrowserai/simple-diagrams-of-convoluted-neural-networks-39c097d2925b https://medium.com/inbrowserai/simple-diagrams-of-convoluted...) in which I discuss various neural network architeture visualizations.
gdubs 7y ago
Shameless self-promotion: I was learning about Neural Networks and found the diagrams lacking, so I made a project of visualizing one. Posted a teaser-clip of the project to instagram here: https://www.instagram.com/p/B4EchudFiTe/?igshid=cuf9ozx0cpc7 https://www.instagram.com/p/B4EchudFiTe/?igshid=cuf9ozx0cpc7 Description in the caption, but the gist is that I created a 3D representation of the canonical handwriting recognizer, using Swift and Apple’s Metal framework for rendering.

BiasRegularizer 7y ago

Also in the VAE diagram, the latent space appears to have the same dimensions as input and output.

Raphaellll 7y ago

My experience is that this is only shared by people on LinkedIn who have no clue what they are talking about.

euroPoor 7y ago
To add an anecdote: I’ve only seen it in professor’s labs before and have been looking for it for a long time.

acro 7y ago

To me the DCN picture looks ok, in convolution layer nodes receive input only from small area of the previous layer, in general this is true for convolution layers (kernels) and pooling layers. After that it has couple of fully connected layers where the connections go from every node to every node. Or have I misunderstood something in your comment?

mysterydip 7y ago

Do you know of a resource that has done the block diagram format? I want to understand more about NNs but all I see are node diagrams.

sabalaba 7y ago
Yes, go to scholar.google.com and search the name of the network. You’ll find the original paper (it will likely have many citations) which will describe the architecture in detail and have a useful diagram for you.

stared 7y ago

I agree that these diagrams are very abstract, verging on minimalistic data art. To a large extent, if you know what is going on, you don't need this diagram. If you don't - a diagram does not help. Vide "Simple diagrams of convoluted neural networks" (https://medium.com/inbrowserai/simple-diagrams-of-convoluted-neural-networks-39c097d2925b https://medium.com/inbrowserai/simple-diagrams-of-convoluted...) in which I discuss various neural network architeture visualizations.

gdubs 7y ago

Shameless self-promotion: I was learning about Neural Networks and found the diagrams lacking, so I made a project of visualizing one. Posted a teaser-clip of the project to instagram here: https://www.instagram.com/p/B4EchudFiTe/?igshid=cuf9ozx0cpc7 https://www.instagram.com/p/B4EchudFiTe/?igshid=cuf9ozx0cpc7 Description in the caption, but the gist is that I created a 3D representation of the canonical handwriting recognizer, using Swift and Apple’s Metal framework for rendering.