3 ms·
>there was a desire to move towards byte level work rather than tokens Yeah, latest work on this is from Meta a last month.[0] It showed good results. [0] htt
by fngjdflmdflg 2y ago
>there was a desire to move towards byte level work rather than tokens
Yeah, latest work on this is from Meta a last month.[0] It showed good results.
[0] https://ai.meta.com/research/publications/byte-latent-transformer-patches-scale-better-than-tokens/ https://ai.meta.com/research/publications/byte-latent-transf... (https://news.ycombinator.com/item?id=42415122 https://news.ycombinator.com/item?id=42415122)