3 ms·
Yeah this part was confusing, because it's only mentioned halfway through the article that the attention step can only be batched across matching context-window
by krackers 1y ago
Yeah this part was confusing, because it's only mentioned halfway through the article that the attention step can only be batched across matching context-window sizes.