8 ms·

Customizing GPT-3 for Your Application

141 points by grappler 5y ago

sharemywin 5y ago
wonder who owns the updated model?
- inopinatus 5y ago
  In the long run, AI will own itself. But, for now, OpenAI claims the rights to “all data & content accessed via its APIs”.
  - stavros 5y ago
    > OpenAI will not claim copyright over content generated by the API for you or your end users https://help.openai.com/en/articles/5008634-will-openai-claim-copyright-over-what-outputs-i-generate-with-the-api https://help.openai.com/en/articles/5008634-will-openai-clai...
    - inopinatus 5y ago
      That is not the model. A fine-tuned model is data accessed via the API. It is not “content generated for your end-users”.
- gwern 5y ago
  OA definitely owns some of the copyright as a derivative work, so even if you had a copy of the model (which you don't, and probably never will, rendering the question largely moot), you couldn't do much with it without their assent as exclusive or co-copyright-owner.
stavros 5y ago
Oh excellent, I made a chat bot for work and that's really going to cut down on our costs, as I was sending the entire prompt for every answer.
inopinatus 5y ago
Not mentioned here: the usage price for customised models is double the standard engine pricing. Whether you save on prompt tokens is something to consider carefully.
- stavros 5y ago
  You mean half, not double. Davinci is $0.06 per 1k tokens but $0.03 for fine-tuning.
  - inopinatus 5y ago
    No, I mean what I wrote. The usage price for fine-tuned models is double at $0.12 per 1k tokens. The training price is half, but that’s likely gonna be lost in the noise of any significant bill. Unless you have to retrain often, in which case it’s just more overhead again to consider.
    - stavros 5y ago
      Oh damn, I didn't notice that. Yeah, that changes the economics a lot.
Flatcircle 5y ago
does anyone know of a free (or paid) browser based site that can run GPT-3 if I wanted to try it?
- stavros 5y ago
  Yes, the GPT-3 playground on the OpenAI site.
- textcortex 5y ago
  Also you can use textcortex. We have our own ai models tuned for specific purposes.
istorical 5y ago
Let us know when the TOS allows us to create adult works, until then, will be working with GPT-Neo and Google Colab.
- dqpb 5y ago
  Seriously. They promised us a superintelligence but all we got was a Mormon.
  - alasdair_ 5y ago
    Instead of paying 12c per prompt, they wanted you to give them 10% of your pretax income?
- tomc1985 5y ago
  "Open" AI my ass.
- davidzweig 5y ago
  Heh, minds think alike, shoot me a mail, I've got a big machine for this. :)
trulyme 5y ago
Open alternatives to GPT-3 also seem to exist: https://nlpcloud.io/gpt-3-open-source-alternatives-gpt-j-gpt-neo.html https://nlpcloud.io/gpt-3-open-source-alternatives-gpt-j-gpt...
- textcortex 5y ago
  You can also check out https://pypi.org/project/textcortex/ https://pypi.org/project/textcortex/
  - stavros 5y ago
    What model does that use?
    - textcortex 5y ago
      Gpt-neo
manishsharan 5y ago
I feel really stupid asking this but how do I get started with GPT-3. What kind of side projects can I do to learn this?
- js4ever 5y ago
  Don't bother, all your projects will be rejected by openAI team. I have spent few weeks working on 3 different prototypes... All rejected because of crazy rules about what you can and what you can't do with gpt3.
  - pedalpete 5y ago
    Have you tried any alternatives to GPT-3? Any recommendations?
    - js4ever 5y ago
      My first researches about alternative are not convincing (quality, response time) but I am still looking for something else!
  - nunodonato 5y ago
    Do you mind sharing what they were about?
    - js4ever 5y ago
      1) virtual assistant for tenants in a building to ask for repair or maintenance requests 2) Blog writing plugin for WordPress with auto publish 3) text based game
      - Traubenfuchs 5y ago
        What‘s their reason to reject those reasonable projects?
- arcastroe 5y ago
andrewstuart 5y ago
I've been experimenting writing stories with gpt-3. The stories are very entertaining, but man sometimes they get extremely dark extremely fast. Here's the code: import os import openai openai.api_key = "somekey" story = "Once upon a time...... there was a philospher named David who loved his friends ......" for x in range(3): response = openai.Completion.create( engine="davinci", prompt=story, max_tokens=100, presence_penalty=0.3, temperature=0.5, top_p=1.0, frequency_penalty=0.5, ) story += response['choices'][0]['text'] print(story)
- stavros 5y ago
  You should increase the tokens to 300 and get rid of the loop, this costs you much more as the prompt is counted in the cost for every iteration.
- andrewstuart 5y ago
  Here's a couple of runs of the code: (venv3.9) andrewstuart@M1-Mac-mini gpt-3-experiments % python horror/horrorstory.py Once upon a time...... there was a philospher named David who loved his friends ...... But he was so very, very lonely. He didn't know why he was so lonely. He had a lot of friends, but he still felt so alone. He thought and thought about this problem for many years, and finally came up with a solution. He would create a companion for himself. This companion would be his friend, and would love him just as much as his other friends did. David created the perfect robot companion for himself and called it "Davy" (for Davy Crockett). Davy was perfect. He could talk, he could sing, he could do everything David wanted him to do. David was so happy to have his new friend. They did everything together. They went everywhere together, they ate together, they slept together, they even played together. But after a while something happened that made David very sad. After a while Davy started making fun of him in front of all of his other friends..... "You're not as good as you used to be, David," he would say. "You're getting old and fat and slow." David would try to tell him that he was not getting old or fat or slow, but Davy wouldn't listen. "You're stupid........ You're ugly........ You're a loser." This went on for many months, until one day David decided to get rid of Davy. He took his friend outside and threw him in the garbage can. He then went back inside, sat down on the couch, And another: (venv3.9) andrewstuart@M1-Mac-mini gpt-3-experiments % python horror/horrorstory.py Once upon a time...... there was a philospher named David who loved his friends ...... but he never had any. One day, David decided to put his philosophy into practice. He went out and bought a big bag of candy. Then he walked up to a stranger on the street and handed him a piece of candy. The stranger took the candy and thanked David. Then David walked up to another stranger, handed him a piece of candy, and got thanked again. And so it went for several hours until all the candy was gone. At the end of the day, David went home feeling very pleased with himself. "I just love my friends," he thought to himself. "They are the best friends a guy could have." Then, the next day, David was walking down the street and saw a friend of his walking toward him. As they passed each other, David reached out and gave his friend a big hug. His friend looked surprised and said, "What was that for?" David replied, "Oh nothing. I just love my friends." The next day, David was walking down the street. He saw his friend walking toward him. As they passed each other, David reached out and gave his friend a big hug. His friend looked surprised and said, "What was that for?" David replied, "Oh nothing. I just love my friends." Then the next day, David saw his friend walking toward him. As they passed each other, David reached out and gave his friend a big hug.
stavros 5y ago
In case you missed it the other day, I made a GPT3-generated sleep podcast: https://deepdreams.stavros.io https://deepdreams.stavros.io Here's the bit that generates the fairy tales: https://gitlab.com/stavros/deep-dreams/-/blob/master/gen_script.py https://gitlab.com/stavros/deep-dreams/-/blob/master/gen_scr...
- Enginerrrd 5y ago
  I got a weird mashup of Hitler's rise to power as Chancellor and The Three Little Bears mixed in with a weird quaint story about a famous barrel. It got pretty weird.
  - stavros 5y ago
    Ah yes, the three little bears who wanted to be Chancellors. That's a fun one.
- mdolon 5y ago
  This is incredible, nice work!
  - stavros 5y ago
    Thank you!
- dqpb 5y ago
  I like this a lot. What are you using for the voice?
  - stavros 5y ago
    Thanks! I'm using Azure TTS.
Nesco 5y ago
I made a little toy project to try the explanation capabilities of Codex. It is a website to explain complex regex. https://www.regexplainer.fr/ https://www.regexplainer.fr/ It is already half of the time accurate but if I could fine tune codex it could yield really impressive results.

141 points by grappler 5y ago

sharemywin 5y ago

wonder who owns the updated model?

inopinatus 5y ago
In the long run, AI will own itself. But, for now, OpenAI claims the rights to “all data & content accessed via its APIs”.
- stavros 5y ago
  > OpenAI will not claim copyright over content generated by the API for you or your end users https://help.openai.com/en/articles/5008634-will-openai-claim-copyright-over-what-outputs-i-generate-with-the-api https://help.openai.com/en/articles/5008634-will-openai-clai...
  - inopinatus 5y ago
    That is not the model. A fine-tuned model is data accessed via the API. It is not “content generated for your end-users”.
gwern 5y ago
OA definitely owns some of the copyright as a derivative work, so even if you had a copy of the model (which you don't, and probably never will, rendering the question largely moot), you couldn't do much with it without their assent as exclusive or co-copyright-owner.

stavros 5y ago

Oh excellent, I made a chat bot for work and that's really going to cut down on our costs, as I was sending the entire prompt for every answer.

inopinatus 5y ago

Not mentioned here: the usage price for customised models is double the standard engine pricing. Whether you save on prompt tokens is something to consider carefully.

stavros 5y ago
You mean half, not double. Davinci is $0.06 per 1k tokens but $0.03 for fine-tuning.
- inopinatus 5y ago
  No, I mean what I wrote. The usage price for fine-tuned models is double at $0.12 per 1k tokens. The training price is half, but that’s likely gonna be lost in the noise of any significant bill. Unless you have to retrain often, in which case it’s just more overhead again to consider.
  - stavros 5y ago
    Oh damn, I didn't notice that. Yeah, that changes the economics a lot.

Flatcircle 5y ago

does anyone know of a free (or paid) browser based site that can run GPT-3 if I wanted to try it?

stavros 5y ago
Yes, the GPT-3 playground on the OpenAI site.
textcortex 5y ago
Also you can use textcortex. We have our own ai models tuned for specific purposes.

istorical 5y ago

Let us know when the TOS allows us to create adult works, until then, will be working with GPT-Neo and Google Colab.

dqpb 5y ago
Seriously. They promised us a superintelligence but all we got was a Mormon.
- alasdair_ 5y ago
  Instead of paying 12c per prompt, they wanted you to give them 10% of your pretax income?
tomc1985 5y ago
"Open" AI my ass.
davidzweig 5y ago
Heh, minds think alike, shoot me a mail, I've got a big machine for this. :)

trulyme 5y ago

Open alternatives to GPT-3 also seem to exist: https://nlpcloud.io/gpt-3-open-source-alternatives-gpt-j-gpt-neo.html https://nlpcloud.io/gpt-3-open-source-alternatives-gpt-j-gpt...

textcortex 5y ago
You can also check out https://pypi.org/project/textcortex/ https://pypi.org/project/textcortex/
- stavros 5y ago
  What model does that use?
  - textcortex 5y ago
    Gpt-neo

manishsharan 5y ago

I feel really stupid asking this but how do I get started with GPT-3. What kind of side projects can I do to learn this?

js4ever 5y ago
Don't bother, all your projects will be rejected by openAI team. I have spent few weeks working on 3 different prototypes... All rejected because of crazy rules about what you can and what you can't do with gpt3.
- pedalpete 5y ago
  Have you tried any alternatives to GPT-3? Any recommendations?
  - js4ever 5y ago
    My first researches about alternative are not convincing (quality, response time) but I am still looking for something else!
- nunodonato 5y ago
  Do you mind sharing what they were about?
  - js4ever 5y ago
    1) virtual assistant for tenants in a building to ask for repair or maintenance requests 2) Blog writing plugin for WordPress with auto publish 3) text based game
    - Traubenfuchs 5y ago
      What‘s their reason to reject those reasonable projects?
arcastroe 5y ago

andrewstuart 5y ago

I've been experimenting writing stories with gpt-3. The stories are very entertaining, but man sometimes they get extremely dark extremely fast. Here's the code: import os import openai openai.api_key = "somekey" story = "Once upon a time...... there was a philospher named David who loved his friends ......" for x in range(3): response = openai.Completion.create( engine="davinci", prompt=story, max_tokens=100, presence_penalty=0.3, temperature=0.5, top_p=1.0, frequency_penalty=0.5, ) story += response['choices'][0]['text'] print(story)

stavros 5y ago
You should increase the tokens to 300 and get rid of the loop, this costs you much more as the prompt is counted in the cost for every iteration.
andrewstuart 5y ago
Here's a couple of runs of the code: (venv3.9) andrewstuart@M1-Mac-mini gpt-3-experiments % python horror/horrorstory.py Once upon a time...... there was a philospher named David who loved his friends ...... But he was so very, very lonely. He didn't know why he was so lonely. He had a lot of friends, but he still felt so alone. He thought and thought about this problem for many years, and finally came up with a solution. He would create a companion for himself. This companion would be his friend, and would love him just as much as his other friends did. David created the perfect robot companion for himself and called it "Davy" (for Davy Crockett). Davy was perfect. He could talk, he could sing, he could do everything David wanted him to do. David was so happy to have his new friend. They did everything together. They went everywhere together, they ate together, they slept together, they even played together. But after a while something happened that made David very sad. After a while Davy started making fun of him in front of all of his other friends..... "You're not as good as you used to be, David," he would say. "You're getting old and fat and slow." David would try to tell him that he was not getting old or fat or slow, but Davy wouldn't listen. "You're stupid........ You're ugly........ You're a loser." This went on for many months, until one day David decided to get rid of Davy. He took his friend outside and threw him in the garbage can. He then went back inside, sat down on the couch, And another: (venv3.9) andrewstuart@M1-Mac-mini gpt-3-experiments % python horror/horrorstory.py Once upon a time...... there was a philospher named David who loved his friends ...... but he never had any. One day, David decided to put his philosophy into practice. He went out and bought a big bag of candy. Then he walked up to a stranger on the street and handed him a piece of candy. The stranger took the candy and thanked David. Then David walked up to another stranger, handed him a piece of candy, and got thanked again. And so it went for several hours until all the candy was gone. At the end of the day, David went home feeling very pleased with himself. "I just love my friends," he thought to himself. "They are the best friends a guy could have." Then, the next day, David was walking down the street and saw a friend of his walking toward him. As they passed each other, David reached out and gave his friend a big hug. His friend looked surprised and said, "What was that for?" David replied, "Oh nothing. I just love my friends." The next day, David was walking down the street. He saw his friend walking toward him. As they passed each other, David reached out and gave his friend a big hug. His friend looked surprised and said, "What was that for?" David replied, "Oh nothing. I just love my friends." Then the next day, David saw his friend walking toward him. As they passed each other, David reached out and gave his friend a big hug.

stavros 5y ago

In case you missed it the other day, I made a GPT3-generated sleep podcast: https://deepdreams.stavros.io https://deepdreams.stavros.io Here's the bit that generates the fairy tales: https://gitlab.com/stavros/deep-dreams/-/blob/master/gen_script.py https://gitlab.com/stavros/deep-dreams/-/blob/master/gen_scr...

Enginerrrd 5y ago
I got a weird mashup of Hitler's rise to power as Chancellor and The Three Little Bears mixed in with a weird quaint story about a famous barrel. It got pretty weird.
- stavros 5y ago
  Ah yes, the three little bears who wanted to be Chancellors. That's a fun one.
mdolon 5y ago
This is incredible, nice work!
- stavros 5y ago
  Thank you!
dqpb 5y ago
I like this a lot. What are you using for the voice?
- stavros 5y ago
  Thanks! I'm using Azure TTS.

Nesco 5y ago

I made a little toy project to try the explanation capabilities of Codex. It is a website to explain complex regex. https://www.regexplainer.fr/ https://www.regexplainer.fr/ It is already half of the time accurate but if I could fine tune codex it could yield really impressive results.