3 ms·
Well I am not sure Gemini or any other LLMs respect `.gitignore` which can immediately make the context window jump over the maximum. Tools like repomix[0] do
by pdimitar 1y ago
Well I am not sure Gemini or any other LLMs respect `.gitignore` which can immediately make the context window jump over the maximum.
Tools like repomix[0] do this better, plus you can add your own extra exclusions on top. It also estimates token usage as a part of its output but I found it too optimistic i.e. it regularly says "40_000 tokens" but when uploading the resulting single XML file to Gemini it's actually f.ex. 55k - 65k tokens.
[0] https://github.com/yamadashy/repomix/ https://github.com/yamadashy/repomix/
- egeozcan 1y agoI agree. I use repomix with AI Studio extensively and never found anything (including the cli agents) that's close. I sometimes upload codebases that are around 600k tokens and even those work. Repomix also lets you create a config file so you can give it ignore/include patterns in addition to .gitignore. It also tells you about the outlier files with exceptionally long content.