3 ms·
Ghost attention is only used in the 70B model in llama 2, FWIW. So would need to make sure comparing apples to apples.
by kromem 3y ago
Ghost attention is only used in the 70B model in llama 2, FWIW.
So would need to make sure comparing apples to apples.