2 ms·Maybe I don't understand the usecase but I'm curious why speed matters given that LLMs are so slow (?)by amelius 2y agoMaybe I don't understand the usecase but I'm curious why speed matters given that LLMs are so slow (?)BigRedEye 2y ago22 minutes for a medium-sized repo is probably slow enough to optimize.elashri 2y agoHowever for these large size repositories. I'm not sure that you fit in the effective context window. I know that there is option to limit the token but then this would be your realistic limit.