According to https://kazemnejad.com/blog/transformer_architecture_positional_encoding/ https://kazemnejad.com/blog/transformer_architecture_positio... they expl

According to https://kazemnejad.com/blog/transformer_architecture_positional_encoding/ https://kazemnejad.com/blog/transformer_architecture_positio... they explain it as a clever way to satisfy the following criteria: - It should output a unique encoding for each time-step (word’s position in a sentence) - Distance between any two time-steps should be consistent across sentences with different lengths. - Our model should generalize to longer sentences without any efforts. Its values should be bounded. - It must be deterministic. Your example contradicts the 'values should be bounded' criterion as it generalizes to longer sentences.