3 ms·
So you want to use a LLM on a code base. You have to feed it your code base as part of the prompt, which is limited in size. I don't suppose there's any soluti
by nottorp 1y ago
So you want to use a LLM on a code base. You have to feed it your code base as part of the prompt, which is limited in size.
I don't suppose there's any solution where you can somehow further train a LLM on your code base to make it become part of the neural net and not part of the prompt?
This could be useful on a large ish code base for helping with onboarding at the least.
Of course you'd have to do both the running and training locally, so there's no incentive for the LLM peddlers to offer that...
- esafak 1y agoModern tools don't fine tune on your code base but use RAG; select the context to feed it to the LLM with each request. The better the context inference algorithm, the better the results. See if your tool tells you what files it selected.
- nottorp 1y agoYes but why? On a large code base it would probably work better if you didn't need to put it all in the context... if you even could...
- esafak 1y agoI am saying the same thing; you want to selectively establish the context, not pass it all.
- deleted 1y ago[deleted]
- nottorp 1y agoI want to train the LLM on the whole code base and then pass a hand picked context specific to what I'm asking. So it doesn't only suggest what can be found on w3schools and geeks4geeks and maybe stackoverflow, but also whatever idioms and utility functions my code base has.