4 ms·
It selects tokens but they expand to embedding vectors which are huge, also in memory and attention requirements, I think?
by kzrdude 2mo ago
It selects tokens but they expand to embedding vectors which are huge, also in memory and attention requirements, I think?