2 ms·
This is what is protected by this patent: "A method comprising: obtaining an input sequence having a first number of inputs arranged according to an input orde
by pnw_hazor 7y ago
This is what is protected by this patent:
"A method comprising: obtaining an input sequence having a first number of inputs arranged according to an input order; processing each input in the input sequence using an encoder recurrent neural network to generate a respective encoder hidden state for each input in the input sequence; and generating an output sequence having a second number of outputs arranged according to an output order, each output in the output sequence being selected from the inputs in the input sequence, comprising, for each position in the output order and beginning at an initial position in the output order: generating, using the encoder hidden states, an attention vector for the position in the output order; generating, using the attention vector, a softmax output for the position in the output order, wherein the softmax output scores each position in the input order; determining, using the softmax output, a pointer to a particular position in the input order; and selecting, as the output for the position in the output order, an input from the input sequence that is located at the particular position in the input order identified by the pointer."