6 ms·
Sin(x)-style encoding is called positional encoding and it’s used in neural radiance fields (NeRFs) and also in transformer-based models.
by gessha 4y ago
Sin(x)-style encoding is called positional encoding and it’s used in neural radiance fields (NeRFs) and also in transformer-based models.
- f_devd 4y agoCould also be Sirens[1] which was all about sin as activation, while sinusoidal positional encoding are (iirc) just from the original transformer paper. [1]: https://arxiv.org/abs/2006.09661 https://arxiv.org/abs/2006.09661