3 ms·
Been playing around with fine-tuning models for specific languages as well (Clojure and Rust mostly), but the persistent problem is high quality data sets, most
by embedding-shape 8mo ago
Been playing around with fine-tuning models for specific languages as well (Clojure and Rust mostly), but the persistent problem is high quality data sets, mostly I've been generating my own based on my own repositories and chat sessions, what approach are you taking for gathering the data?
- girvo 8mo agoYeah I have a body of work of 15 years, plus I’ve been building labelled sets from open source (the source code isn’t quite enough on its own) Now I’m using that to generate synthetic sets and clean it up, but man I’m struggling hah. Fun though.
- numberwan9 8mo agoHave you looked on HF? Here's one that is fine tuned on Rust https://huggingface.co/Fortytwo-Network/Strand-Rust-Coder-14B-v1 https://huggingface.co/Fortytwo-Network/Strand-Rust-Coder-14...