3 ms·
The behaviour you described is what happens when you have small context windows. Perhaps you're feeding the models with more tokens than you think you are. I ha
by seunosewa 2y ago
The behaviour you described is what happens when you have small context windows. Perhaps you're feeding the models with more tokens than you think you are. I have enjoyed loading large codebases into AI Studio and getting very satisfying and accurate answers because the models have 1M to 2M token context windows.
- dr_kiszonka 2y agoHow do you get those large codebases into AI Studio? Concat everything into one big file?
- adamgordonbell 2y agoBasically yes, I have a helper program, but that's mainly what it does.
- social_quotient 2y agoConcat to a file but it helps to make an ascii tree at the top and then for each merged file out its path and orientation details. I’ve also started playing with adding line ranges to the ascii tree hoping that the LLMs (more specifically the agentic ones) start getting smart enough to jump to the relevant section.
- msoad 2y agoI use yek https://github.com/bodo-run/yek https://github.com/bodo-run/yek