2 ms·
Does anyone know of a more semantically meaningful way of chunking code in a generalizable way? Token count seems like it'd leave out meaningful context, or inc
by lordofgibbons 2y ago
Does anyone know of a more semantically meaningful way of chunking code in a generalizable way? Token count seems like it'd leave out meaningful context, or include unrelated context.
- energy123 2y agoI have an LLM summarize each file, and feed in a list of summaries categorized by theme, along with the function signatures and a tree of the directory. I only paste the full code of the files that are very important for the task.