4 ms·
> multi token prediction of sufficient length Is multi token prediction the same as predicting the embedding of a complex token (the articulation of those inpu
by mdp2021 2y ago
> multi token prediction of sufficient length
Is multi token prediction the same as predicting the embedding of a complex token (the articulation of those input tokens in a sentence)?
- blackeyeblitzar 2y agoTo be honest I don’t know. Maybe the only way to know is to build and measure all these variations.