4 ms·
> what is fine-tuning, like what do you have to actually do? For GPT-2 it is as easy as creating a corpus you want to fine-tune on, adding new unseen tokens to
by voces 6y ago
> what is fine-tuning, like what do you have to actually do?
For GPT-2 it is as easy as creating a corpus you want to fine-tune on, adding new unseen tokens to the dictionary, and run a finetuning command. https://huggingface.co/transformers/v1.2.0/examples.html#fine-tuning https://huggingface.co/transformers/v1.2.0/examples.html#fin...
> Has anyone done it
Many have. AI Dungeon is a great example. Others are experimenting with humor generation, short story synopsis generation/creative writing, and supportive chat bots.