You could store a pretty gigantic graph using 600MB. They're not saying we store the weights, they're saying that we store the "architecture" that you overlay

You could store a pretty gigantic graph using 600MB. They're not saying we store the weights, they're saying that we store the "architecture" that you overlay the weights on with training.