2 ms·

You can store the weights in ROM. But you also have input dependent activations. You need RAM for these.