4 ms·
> Because memory consumption grows linearly with sequence length, the maximum context window is limited by practical hardware constraints I thought the number
by t_mann 2y ago
> Because memory consumption grows linearly with sequence length, the maximum context window is limited by practical hardware constraints
I thought the number of parameters grows quadratically with context window length - what do they mean?