4 ms·
Question, Can I give openAI some data for it to process so I can use it to my own advantage. Say I want to train it on specific topic of information I've gather
by thedangler 4y ago
Question, Can I give openAI some data for it to process so I can use it to my own advantage. Say I want to train it on specific topic of information I've gathered over the years. Can I some how give it that data and then I can use the API to get back out data in a chat or some other forms of questions?
I'm not too familiar with how it works.
- bicx 4y agoYou can do this to an extent via fine-tuning, but you will need to do so via one of the other GPT-3 models rather than the ChatGPT API model (`GPT-3.5-turbo`). The latter is not available for fine-tuning.
- thedangler 4y agoDoes openAI have models for data to train it with.. data like pricing, locations, products .... Or would I have to use something else? The reason I ask because companies are using it with their own data, like Shopify... sooo it has to be trained somehow.
- kfarr 4y agoThe docs on fine tuning are excellent: https://platform.openai.com/docs/guides/fine-tuning https://platform.openai.com/docs/guides/fine-tuning
- visarga 4y agoYes, you bring your own data, or you generate data with the model, that works too. I have generated training data with GPT3 and trained smaller HuggingFace models on it.
- thedangler 4y agoAny links on how to get started with this?
- visarga 4y agoDepends on what task you have, but look at sbert.net for the student model. Generating data with GPT3 means solving the prompt, also task specific.
- shostack 4y agoI wonder if it would be possible to simply fine tune another GPT-3 model, have ChatGPT form the query based on input into ChatGPT's API, then pass that response into a call to the GPT-3 model, and take the response from that, pass it into ChatGPT, and ask for it to parse it and make sense of it.
- deleted 4y ago[deleted]
- IanCal 4y agoYou could use the embeddings to search for a relevant article or doc/docs then feed those in as input to chatgpt, followed by your question.