3 ms·
Can you explain the odd looking connections to the decoder that appear in V2 and onwards? It's not entirely obvious to me from the description how the attention
by alexbeloi 10y ago
Can you explain the odd looking connections to the decoder that appear in V2 and onwards? It's not entirely obvious to me from the description how the attention is applied.
In the first part of the decoder rollout, the diagram connects the (concatenated?) output of the encoder into the middle(?) of the first output of the decoder rollout. In what sense?
For the second rollout of the decoder the diagram shows 3 arrows going into the LSTM cell, what is that (left-facing) arrow on the right side doing?