3 ms·

Prompt engineering now (as I understand it) is you're refining and refining the prompt itself. Perhaps what we might see is you give it a prompt then just keep

by ekanes 3y ago

Prompt engineering now (as I understand it) is you're refining and refining the prompt itself. Perhaps what we might see is you give it a prompt then just keep adjusting the response dynamically, and then it can remember the entire concept as a saved prompt.

newswasboring 3y ago
I already use ChatGPT like this. After every good outcome I say something like "modify my original prompt to include all the things we learned in this chat session". It has mixed results, context window being the biggest factor I guess. Longer conversations (where I am trying to write stories specially) do not produce good prompts as it becomes super specific even if I tell it to generalize specific things.
- daveguy 3y ago
  Edit: I may have misunderstood. You instruct it to modify the original prompt of that session to include what you learned? Do you ask it to repeat the new prompt? This is interesting, but it wouldn't help for any future sessions. --- It has zero effect. Your prompt consists of the OpenAI prompt + your conversation so far. There is no cross-prompt learning, knowledge or intelligence [except for, in the future, what OpenAI decides to include in model training of new releases]. The main reason for this is there are a limited number of tokens that can be used as the prompt. If you "include everything we learned in this chat session" it would have to include the entire chat session as part of all future prompts and you would quickly run out of tokens for the prompt. Training happens on a corpus, but not during regular use. Perceived "learning" is just context provided by the session-limited prompt.
  - travisjungroth 3y ago
    If that person is doing what I think, it’s that they get back a prompt to use next time. Write a followup email to A about B with X,Y,Z characteristics. [iterative chat] Give me back a prompt for next time. Ok: “Write a followup email to A about B with W,X,Y characteristics.”
  - newswasboring 3y ago
    > you ask it to repeat the new prompt? I thought that was understood. I basically ask it to improve my initial prompt, like asking it how could I have asked this better. Sometimes it gets good results, like when it taught me how to pose formatting to it. I did not know how to make it output in a certain user defined format, it never occured to me that I can just give it an example, the modified prompt taught me that trick. Now it's super common everywhere and I think is the basis of a lot of langchain.
shanebellone 3y ago
I think the intention is to eliminate the prompt component entirely. This would shift AI from "generative autofill" to a "repository of truth". The former is useless for most business applications. The latter is the holy grail of product.

by ekanes 3y ago

newswasboring 3y ago

I already use ChatGPT like this. After every good outcome I say something like "modify my original prompt to include all the things we learned in this chat session". It has mixed results, context window being the biggest factor I guess. Longer conversations (where I am trying to write stories specially) do not produce good prompts as it becomes super specific even if I tell it to generalize specific things.

daveguy 3y ago
Edit: I may have misunderstood. You instruct it to modify the original prompt of that session to include what you learned? Do you ask it to repeat the new prompt? This is interesting, but it wouldn't help for any future sessions. --- It has zero effect. Your prompt consists of the OpenAI prompt + your conversation so far. There is no cross-prompt learning, knowledge or intelligence [except for, in the future, what OpenAI decides to include in model training of new releases]. The main reason for this is there are a limited number of tokens that can be used as the prompt. If you "include everything we learned in this chat session" it would have to include the entire chat session as part of all future prompts and you would quickly run out of tokens for the prompt. Training happens on a corpus, but not during regular use. Perceived "learning" is just context provided by the session-limited prompt.
- travisjungroth 3y ago
  If that person is doing what I think, it’s that they get back a prompt to use next time. Write a followup email to A about B with X,Y,Z characteristics. [iterative chat] Give me back a prompt for next time. Ok: “Write a followup email to A about B with W,X,Y characteristics.”
- newswasboring 3y ago
  > you ask it to repeat the new prompt? I thought that was understood. I basically ask it to improve my initial prompt, like asking it how could I have asked this better. Sometimes it gets good results, like when it taught me how to pose formatting to it. I did not know how to make it output in a certain user defined format, it never occured to me that I can just give it an example, the modified prompt taught me that trick. Now it's super common everywhere and I think is the basis of a lot of langchain.

shanebellone 3y ago

I think the intention is to eliminate the prompt component entirely. This would shift AI from "generative autofill" to a "repository of truth". The former is useless for most business applications. The latter is the holy grail of product.