3 ms·
> I disagree, I may not have the whole codebase in my head in one moment but I have had all of it in my head at some point, and it is still there, that is not t
by PaulDavisThe1st 1y ago
> I disagree, I may not have the whole codebase in my head in one moment but I have had all of it in my head at some point, and it is still there, that is not true of an LLM.
All 3 points (you have had all of it your head at some point, it is still there, that is not true of an LLM) are mere conjectures, and not provable at this time, certainly not in the general case. You may be able to show this of some codebases for some developers and for some LLMs, but not all.
- fnordsensei 1y agoThe brain can literally not process any piece of information without being changed by the act of processing it. Neuronal pathways are constantly being reinforced or weakened. Even remembering alters the memory being recalled, entirely unlike how computers work.
- johnisgood 1y agoFor humans, remembering strengthens that memory, even if it is dead wrong.
- Lutger 1y agoI've always find it interesting that once I take a wrong turn finding my way through the city and I'm not deliberate about remembering this was, in fact, a mistake, I am more prone to taking the same wrong turn again the next time.
- dberge 1y ago> once I take a wrong turn finding my way through the city... I am more prone to taking the same wrong turn again You may want to stay home then to avoid getting lost.
- jbs789 1y agoI'm not sure the idea that a developer maintains a high level understanding is all that controversial...
- animuchan 1y agoThe trend for this idea's controversiality is shown on this very small chart: /
- ehnto 1y agoI never intended to say it was true of all codebases for all developers, that would make no sense. I don't know all developers. I think it's objectively true that the information is not in the LLM. It did not have all codebases to train with, and they do not (immediately) retrain on the codebases they encounter through usage.