5 ms·

Does anyone have any examples of promoting to feed such a large amount of tokens? For example, would you use something like “I am going to send you an entire co

Does anyone have any examples of promoting to feed such a large amount of tokens? For example, would you use something like “I am going to send you an entire codebase, with the filename and path, followed by the file content. Here is the first of 239 files: …”

mysterydip 3y ago
Sounds like a return to the days of download managers or file splitters :)
fragsworth 3y ago
I think what's more important is the end part of your prompt, which explains what was previously described and includes a request/question.
r3trohack3r 3y ago
I already do this with the current context limits. I include a few of my relevant source files before my prompt in ChatGPT. It work’s unreasonably well. Something like the following Here is the Template class: … Here is an example component: … Here is an example Input element: … I need to create another input element that allows me to select a number from a drop down between 1/32 and 24/32 in 1/32 increments
dested 3y ago
Here's someone that passed a 23 page congressional document: https://twitter.com/SullyOmarr/status/1654576774976770048 https://twitter.com/SullyOmarr/status/1654576774976770048
danielbln 3y ago
I've had access to the 32k model for a bit and I've been using this to collect and stuff codebases into the context: https://github.com/mpoon/gpt-repository-loader https://github.com/mpoon/gpt-repository-loader It works really well, you can tell it to implement new features or mutate parts of the code and it having the entire (or a lot of) the code in its context really improves the output. The biggest caveat: shit is expensive! A full 32k token request will run you like $2, if you do dialog back and forth you can rack up quite the bill quickly. If it was 10x cheaper, I would use nothing else, having a large context window is that much of a game changer. As it stands, I _very_ carefully construct the prompt and move the conversation out of the 32k into the 8k model as fast as I can to save cost.
- bamboozled 3y ago
  Do you use it for proprietary code and if so, you don’t feel weird about it ?
  - danielbln 3y ago
    Not weirder than using Github, or Outlook or Slack or whatever.
  - RivieraKid 3y ago
    I wouldn't feel weird about it. The risks - someone stealing know-how / someone finding a security hole - are negligible.
- guzik 3y ago
  How it calculates the price? I thought that once you load the content (32k token request / 2$) it will remember the context so you can ask questions much cheaper.
  - mediaman 3y ago
    It does not have memory outside the context window. If you want to have a back-and-forth with it about a document, that document must be provided in the context (along with your other relevant chat history) with every request. This is why it's so easy to burn up lots of tokens very fast.
noonething 3y ago
You could see the legal impact of your actions before you take them. You could template out an Operating system and have it fill in the blanks. You could rewrite entire literary arts, in the authors style, to cater to your reading style or story preferences.

mysterydip 3y ago

Sounds like a return to the days of download managers or file splitters :)

fragsworth 3y ago

I think what's more important is the end part of your prompt, which explains what was previously described and includes a request/question.

r3trohack3r 3y ago

I already do this with the current context limits. I include a few of my relevant source files before my prompt in ChatGPT. It work’s unreasonably well. Something like the following Here is the Template class: … Here is an example component: … Here is an example Input element: … I need to create another input element that allows me to select a number from a drop down between 1/32 and 24/32 in 1/32 increments

dested 3y ago

Here's someone that passed a 23 page congressional document: https://twitter.com/SullyOmarr/status/1654576774976770048 https://twitter.com/SullyOmarr/status/1654576774976770048

danielbln 3y ago

I've had access to the 32k model for a bit and I've been using this to collect and stuff codebases into the context: https://github.com/mpoon/gpt-repository-loader https://github.com/mpoon/gpt-repository-loader It works really well, you can tell it to implement new features or mutate parts of the code and it having the entire (or a lot of) the code in its context really improves the output. The biggest caveat: shit is expensive! A full 32k token request will run you like $2, if you do dialog back and forth you can rack up quite the bill quickly. If it was 10x cheaper, I would use nothing else, having a large context window is that much of a game changer. As it stands, I _very_ carefully construct the prompt and move the conversation out of the 32k into the 8k model as fast as I can to save cost.

bamboozled 3y ago
Do you use it for proprietary code and if so, you don’t feel weird about it ?
- danielbln 3y ago
  Not weirder than using Github, or Outlook or Slack or whatever.
- RivieraKid 3y ago
  I wouldn't feel weird about it. The risks - someone stealing know-how / someone finding a security hole - are negligible.
guzik 3y ago
How it calculates the price? I thought that once you load the content (32k token request / 2$) it will remember the context so you can ask questions much cheaper.
- mediaman 3y ago
  It does not have memory outside the context window. If you want to have a back-and-forth with it about a document, that document must be provided in the context (along with your other relevant chat history) with every request. This is why it's so easy to burn up lots of tokens very fast.

noonething 3y ago

You could see the legal impact of your actions before you take them. You could template out an Operating system and have it fill in the blanks. You could rewrite entire literary arts, in the authors style, to cater to your reading style or story preferences.