3 ms·
Because tokens are the unit of work in an LLM and it’s not correct to say that tokens or even embeddings change between models.
by qeternity 4y ago
Because tokens are the unit of work in an LLM and it’s not correct to say that tokens or even embeddings change between models.