2 ms·
Not sure I follow. You seem to have omitted the part of 1) explaining how the LLM knew that my_function even existed - presumably, it read the entire file to di
by wavemode 8mo ago
Not sure I follow. You seem to have omitted the part of 1) explaining how the LLM knew that my_function even existed - presumably, it read the entire file to discover that, which is way more input tokens than your hypothetical available_functions response.
- dnautics 8mo agoReading files is not that input tokien heavy, I suspect. But anyways I omitted it because presumably it would have done so to gain local context in general.
- wavemode 8mo agoI still don't follow. Why doesn't that count as cost?
- dnautics 8mo agoA+B > A+C => B > C
- wavemode 8mo agoThe LLM doesn't need to read the whole file in example 2). Why would it?
- dnautics 8mo agoWhere would it inject the code?
- wavemode 8mo agoPresumably, the same MCP tool allowing it to read specific definitions would also allow it to write out specific definitions (rather than, again, having to write out the whole file just to make one change). Otherwise it defeats the purpose. This is the same way humans work on code. You never read an entire file top to bottom just to find out one thing, and you never type out the entire file just to make one change. This would, understandably, be very taxing on your working memory, and you'd probably make more mistakes.
- dnautics 8mo agoHonestly claude doesn't typically do this the way you think. It's perfectly capable of working in files that are "way too big for its allowed download window". But in general you want some amount of context (what functions are available in scope, etc.)