> “forget gate”, “input gate”, “output gate” These are legit: cell_h = cell_(h-1) * forget_gate + tanh(linear(input_h)) * input_gate out_h = cell_h * output

> “forget gate”, “input gate”, “output gate” These are legit: cell_h = cell_(h-1) * forget_gate + tanh(linear(input_h)) * input_gate out_h = cell_h * output_gate see? forget_gate masks input by multiplying with numbers in [0, 1], input_gate controls the external input, output_gate controls the output of course