4 ms·
I'm not sure of the mechanics but I think GPT can be fine tuned to get something more in line with the actual texts https://beta.openai.com/docs/guides/fine-tu
by firasd 4y ago
I'm not sure of the mechanics but I think GPT can be fine tuned to get something more in line with the actual texts
https://beta.openai.com/docs/guides/fine-tuning https://beta.openai.com/docs/guides/fine-tuning
While we're here, does anybody know? Apparently GPT is fine tuned by sending it data like:
{"prompt": "<prompt text>", "completion": "<ideal generated text>"}
But how would we use specify this data to make it write like the Arthur Conan Doyle stories
- hooande 4y agoIt doesn't work like that. The term "fine tuning" is very misleading and I see people misunderstanding it all the time. Props to you for looking into the details. In this sense, GPT fine tuning is really geared toward question answer or linguistic style for specific applications. Say for example, uploading your company's FAQ so that it gives answers tailored to your business details. Or to make it say "please" and "thank you" more often as part of the response, etc This version of fine-tuning is really more like reinforcement learning, teaching it how to respond to specific cases and examples. There was a time when fine-tuning a transformer meant using the underlying token embeddings to train a model from scratch on custom data. But I don't know if anyone ever had a lot of success with that, including me when I tried it years ago.
- firasd 4y agoAh interesting, thanks. I had seen an example where someone had made a bot to talk with her younger self based on diary entries but looks like she put the old diary quotes in a prompt https://twitter.com/michellehuang42/status/1597702989493698561 https://twitter.com/michellehuang42/status/15977029894936985...