4 ms·
That's already the case with visible text. There's an embedding inside the model as it spits out the next token.
by pishpash 2y ago
That's already the case with visible text. There's an embedding inside the model as it spits out the next token.
- antirez 2y agoSure, but you have multiple thoughts tokens in the context the model sees to process the next token.