2 ms·
It depends on how you define fed forward, LLMs are typically auto regressive and so can take their own previous output into consideration when generating tokens
by toxik 3y ago
It depends on how you define fed forward, LLMs are typically auto regressive and so can take their own previous output into consideration when generating tokens.