I was talking about the graphs here: https://i.imgur.com/M6P71aC.jpg https://i.imgur.com/M6P71aC.jpg I missed that he's not storing activations for those graph

I was talking about the graphs here: https://i.imgur.com/M6P71aC.jpg https://i.imgur.com/M6P71aC.jpg I missed that he's not storing activations for those graphs, he's storing activations+batch norm. See my edit.