4 ms·
more dense tokens means more stuff to fit into the embedding space which is per token, so more work to disentangle later
by not-a-llm 3mo ago
more dense tokens means more stuff to fit into the embedding space which is per token, so more work to disentangle later