4 ms·
How can I learn more about this? Is it like in the early GPT-3 days, when you had to give it a bunch of examples and hope it catches the pattern?
by andai 2y ago
How can I learn more about this?
Is it like in the early GPT-3 days, when you had to give it a bunch of examples and hope it catches the pattern?
- im3w1l 2y agoBack in those days I would either create a little scene with a knowledgeable person and someone with a question. Or I would start writing a monologue and generate a continuation for it.
- nullc 2y agoNot so much examples, though those can help... but you have to imagine a document of a sort that would be in the training set whose completion would be the answer you seek. Like, "Solve this equation for me: " more likely gets completed with "Do your own homework buddy!" or just a list of more similar questions without answers. While, "careful analysis revealed the solution the equation X turned out to have a solution of", might be more likely to get what you want. Also a lot more sensitivity to tone and context, write a prompt that sounds like it was written on some teenager fan subreddit, you'll get an answer of the sort that sounds like it belongs there.