2 ms·
Could I just train a very small LLM with an English dictionary + Python + large API documentation + large Python code base? Then do some chat fine tuning (like
by nico 3y ago
Could I just train a very small LLM with an English dictionary + Python + large API documentation + large Python code base?
Then do some chat fine tuning (like what HF did with StarCoder to get ChatCoder)
And get a lightweight LLM that knows the docs and code for the thing I need it for
After that, maybe incrementally fine tune the model as part of your CI/CD process