3 ms·
> and are looking at other models we can use and fine tune. This seems to be a common misconception in the industry - fine-tuning a model will almost certainly
by smoldesu 3y ago
> and are looking at other models we can use and fine tune.
This seems to be a common misconception in the industry - fine-tuning a model will almost certainly lower the quality of your response in these situations. You do not want to waste your time fine-tuning on low-quality code that will not exist in-context.
You are going to be stuck with off-the-shelf commercially licensed models for now, which will be effectively useless on codebases that extend beyond their fairly limited context (8k tokens, <1k SLOC). It is very likely that the tool you're searching for simply isn't ready yet.