3 ms·
this is brilliant. could you do a series about how to prepare custom data sets for finetuning. thats the part that a lot of other tutorials skip on. Especially
by sandGorgon 3y ago
this is brilliant.
could you do a series about how to prepare custom data sets for finetuning. thats the part that a lot of other tutorials skip on.
Especially for different goals - like safety, accuracy, etc.
- jawerty 3y agoOf course I have a few where I web scrape and build a dataset for myself with prefix tokens. I can break that down more on a specific stream about it.
- sandGorgon 3y agowell not so much as the raw data acquisition (scraping and stuff), but really data prep for finetuning. I'm hearing that each model needs it in a different format - chat finetuning data is different from instruct, etc etc