4 ms·

I don't think it will evolve at all, because models will just become better at understanding what people mean. There's no point in trying to be a better prompte

by seydor 4y ago

I don't think it will evolve at all, because models will just become better at understanding what people mean. There's no point in trying to be a better prompter as a competitive advantage. Already, chatGPT and bing can both give great on-topic answers to 3 word queries. and the fact that you can infinitely refine it is great OTOH i think there is space for developing GUIs for prompts. Makes them more engaging

addisonl 4y ago
> Already, chatGPT and bing can both give great on-topic answers to 3 word queries. and the fact that you can infinitely refine it is great You’re completely ignoring the system prompts that OpenAI/Bing have already set up so your “3 word query” works as you intend. These system prompts are what prompt engineering is all about.
- seydor 4y ago
  these prompts by definition do not need engineering because they work for all cases all the time. and they can only get better over time
  - lupire 4y ago
    Huh? How would they get better without engineering? Why would it be a good idea to use them in all cases all of the time?
    - seydor 4y ago
      There are exactly 2 of those prompts in the whole world
      - bee_rider 4y ago
        I bet they took a couple tries to come up with them.
  - simonw 4y ago
    Here's an early version of the Bing prompt. Last I heard it was already on version 96, and that was a few weeks ago: https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked
devmunchies 4y ago
Disagree. Some examples. If I have an LLM in a video game that generates NPC dialog, I might want to feed more information to the prompt based on things my character has done in the game so the NPC dialogue is more relevant to me. Maybe I want to inject the user’s location or the current weather in Sunnyvale, CA for the specific query. Or maybe I want to inject that the user is currently at Disneyland. Maybe the user really likes a specific tv show and I want to let the model know that. Or maybe the specific TV show was DMCA’d by an IP owner and I need to put that in the prompt. Do I need to detect that the user is below 13 yrs old and use a different prompt (or a different model altogether)? Maybe I want the model to only ever respond with JSON without the user needing to specify. It needs to be clarified in the prompt with no way for the user to override it. Models can be simplified to: input to output. Prompt engineering will be engineering the inputs.
- mncharity 4y ago
  Another example. Someone has yet another new programming language. Expected infrastructure was github, website with docs, editor/IDE integration, community repo, slack/mailinglist, etc. "Now" it's also a "chatoverflow" capable of answering "how do I ...?" and "translate this <code in popular language>". What does a MVP training set for this look like? Can translation be pushed to permit assimilating "batteries" from similar languages? What does the infrastructure for that look like? Does this mean a half century of agonizingly slow language evolution is about to state change?
- seydor 4y ago
  By the time you have finished writing the job description for this prompt engineer, you have your prompt ready.

by seydor 4y ago

addisonl 4y ago

> Already, chatGPT and bing can both give great on-topic answers to 3 word queries. and the fact that you can infinitely refine it is great You’re completely ignoring the system prompts that OpenAI/Bing have already set up so your “3 word query” works as you intend. These system prompts are what prompt engineering is all about.

seydor 4y ago
these prompts by definition do not need engineering because they work for all cases all the time. and they can only get better over time
- lupire 4y ago
  Huh? How would they get better without engineering? Why would it be a good idea to use them in all cases all of the time?
  - seydor 4y ago
    There are exactly 2 of those prompts in the whole world
    - bee_rider 4y ago
      I bet they took a couple tries to come up with them.
- simonw 4y ago
  Here's an early version of the Bing prompt. Last I heard it was already on version 96, and that was a few weeks ago: https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked

devmunchies 4y ago

Disagree. Some examples. If I have an LLM in a video game that generates NPC dialog, I might want to feed more information to the prompt based on things my character has done in the game so the NPC dialogue is more relevant to me. Maybe I want to inject the user’s location or the current weather in Sunnyvale, CA for the specific query. Or maybe I want to inject that the user is currently at Disneyland. Maybe the user really likes a specific tv show and I want to let the model know that. Or maybe the specific TV show was DMCA’d by an IP owner and I need to put that in the prompt. Do I need to detect that the user is below 13 yrs old and use a different prompt (or a different model altogether)? Maybe I want the model to only ever respond with JSON without the user needing to specify. It needs to be clarified in the prompt with no way for the user to override it. Models can be simplified to: input to output. Prompt engineering will be engineering the inputs.

mncharity 4y ago
Another example. Someone has yet another new programming language. Expected infrastructure was github, website with docs, editor/IDE integration, community repo, slack/mailinglist, etc. "Now" it's also a "chatoverflow" capable of answering "how do I ...?" and "translate this <code in popular language>". What does a MVP training set for this look like? Can translation be pushed to permit assimilating "batteries" from similar languages? What does the infrastructure for that look like? Does this mean a half century of agonizingly slow language evolution is about to state change?
seydor 4y ago
By the time you have finished writing the job description for this prompt engineer, you have your prompt ready.