I only gave it a quick skim but it seems to match what I have learned so far, but I'm also learning from things that people said online so there remains the pos

I only gave it a quick skim but it seems to match what I have learned so far, but I'm also learning from things that people said online so there remains the possibility of common misconceptions. The ALiBi stuff just makes sense to me. I don't understand why the Positional Sinusoidal Encoding was used initially. I assume there were good reasons for it but I haven't seen an explanation, (pointers to one appreciated).