Aesthetically enjoyable and with an organic feel, the intricate detail suggests a lot of information is represented, yet Graphcore's diagram does not seem immed

Aesthetically enjoyable and with an organic feel, the intricate detail suggests a lot of information is represented, yet Graphcore's diagram does not seem immediately apprehensible. In the OP article's masthead, the clusters are labelled, this is AlexNet's computational graph from a Tensorflow description (depicted in full lower down the page). On the right is "Conv1 11x11 forward [3 in, 64 out]" which suggests a Convolutional Layer with 3 inputs and 64 outputs. Forward, presumably, the direction of tensors flowing through the layer. Alexnet's Layer 1 is Convolutional [a] : • Images: 227x227x3 • F (receptive field size): 11 • S (stride) = 4 • Convlayer output: 55x55x96 Compare Colah's 2D Convolutional NN depiction: http://colah.github.io/posts/2014-07-Conv-Nets-Modular/ http://colah.github.io/posts/2014-07-Conv-Nets-Modular/ or CS231n's page containing both structural and activation diagrams: http://cs231n.github.io/convolutional-networks/ http://cs231n.github.io/convolutional-networks/ In reply to your linked tweet [1], Chintala asserts the links are " compute/mem activity on their cores" and "connections between clusters are memory transfers/activity" Does Chintala mean compute cores, Graphcore's IPUs ? From Graphcore's page: "computational graphs are made up of vertices (think neurons) for the compute elements, connected by edges (think synapses), which describe the communication paths between vertices." What do Graphcore's colours represent ? What is an IPU ? Is an IPU hardware like Google's TPU ? [edit] Graphcore explains: "Our Poplar graph compiler has converted a description of the network into a computational graph of 18.7 million vertices and 115.8 million edges. This graph represents AlexNet as a highly-parallel execution plan for the IPU. The vertices of the graph represent computation processes and the edges represent communication between processes. The layers in the graph are labelled with the corresponding layers from the high level description of the network. The clearly visible clustering is the result of intensive communication between processes in each layer of the network, with lighter communication between layers." So it is a compiled computational graph just like Tensorflow's. I cannot fathom it further and am unsure how or if to proceed. Counting the little dots and lines in cluster Conv1 and relating this to to 11x11 [3 in, 64 out] & Alexnet's 1st Layer could be a place to start an inquiry. [a] http://vision.stanford.edu/teaching/cs231b_spring1415/slides/alexnet_tugce_kyunghee.pdf http://vision.stanford.edu/teaching/cs231b_spring1415/slides...