3 ms·
Besides technical details, in a normal usage scenario, the context length is also much greater than the generation length.
by grayxu 2y ago
Besides technical details, in a normal usage scenario, the context length is also much greater than the generation length.