2 ms·
I think this concept will be the future of coding. You'll have something like CodeLLaMA-javascript trained specifically for the language, then you'll have LoRA
by gorbypark 3y ago
I think this concept will be the future of coding. You'll have something like CodeLLaMA-javascript trained specifically for the language, then you'll have LoRA-like files distributed with/for each library. I can image something like the definitely-typed project for typescript types, but instead of doing `yarn add @types/someLibrary` you'll be able to do `yarn add @loramodels/someLibrary`.
I'm javascript centric these days, but the same concept should work for most languages with a package manager.
Some of these features could even be integrated into say yarn/npm directly, you currently have a devDependencies section of a package.json..I could imaging having something along the lines of a "llmDependencies" section to define which main model and version to use and which "library" models to use.