Moreover: The integers are really indeces into the embedding space. So you'd want to think more that the model maintains a giant matrix (one row = one token;

Moreover: The integers are really indeces into the embedding space. So you'd want to think more that the model maintains a giant matrix (one row = one token; one column is an embedding feature). The array of indices gets the relevant embeddings to shove through the rest of the model's forward pass.