3 ms·
I am super curious about tensor parallelism and the mechanisms behind how some models can activate only some of their attentions.
by didip 9mo ago
I am super curious about tensor parallelism and the mechanisms behind how some models can activate only some of their attentions.