3 ms·
The goal is for the LLMs we have to be so good at long context tasks and reasoning about code that you can simply paste the entire documentation for your new la
by thorum 2y ago
The goal is for the LLMs we have to be so good at long context tasks and reasoning about code that you can simply paste the entire documentation for your new language and they’ll figure it out.
Once you have that working, you can generate synthetic examples to train the next version of the LLM, or for open source coding models, a small LoRA file that anyone can download to add support to their model of choice.