5 ms·

Somewhat OT but the OP on Twitter has "prompt engineer" in his bio. Is that a real thing now?

by malshe 4y ago

Ozzie_osman 4y ago
Yea, just search it on Twitter or LinkedIn.
- malshe 4y ago
  That's a good idea. I am now curious about this
O__________O 4y ago
Given numerous individuals are paid to engineer prompts, appears so, regardless of how common it is as a specific role.
- Computeiful 4y ago
  Interesting. Who are paying these people? I'm not aware of any software products based on ChatGPT&co
  - O__________O 4y ago
    Any business that uses generative AI and injects custom prompts into their workflow that they pay to have created is doing prompt engineering.
  - lmeyerov 4y ago
    We (and many others) have a team building fun things into our data analysis tool here. For what will soon become a 10% time prompt engineering role for a much easier kind of security investigations experience, we are hiring cleared security folks in Australia (SIEM / python SE) and a cleared cybersecurity data scientist in the US. See Google docs @ graphistry.com/careers Likewise, if you use a SIEM/Splunk/Neo4j/SQL today and want a better experience for it, feel free to ping for the early access program. You can see our Nvidia GTC talk on the GPU SOC for types of experiences we are building in general. GPT 3 already enabled way easier experiences here, and then GPT 4's quality jump shifted it from feeling working with a weirdly well-read 10yr old to working more with a serious colleague.
    - the_last_human 4y ago
      Serious question. How can you reconcile needing CLEARED individuals to perform the work but give the data to a non-cleared entity who seems to have issues with security? Perhaps there’s now a self hosted or enterprise version where they promise not to leak it?
      - O__________O 4y ago
        One explanation would simply be that the LLM used is internally created or using an open source LLM.
      - lmeyerov 4y ago
        Fair questions! We work with everyone from individual university researchers trying to understand cancer genomes or European economic plans in their graph DBs, to big corporations struggling with supply chains in Databricks, to government cyber & fraud teams using Splunk. For many, an OpenAI/Azure LLM is fine, or with specific guard rails they've been having us put in. But yes, when talking with banking & government teams, the conversation is generally more around self-hosted models. Privacy + cost both important there -- there is a LOT of data folks want to push through LLM embeddings, graph neural nets, etc. We generally prefer bigger contracts in the air-gapped-everything world, especially for truly massive data, though thankfully, costs are plummeting for LLMs. Alpaca/Dolly are great examples here. Some folks will buy 8-100 GPUs at a time, so this is no different for those. My $ is on continuing to shrink LLMs down to regular single-GPU being fine for many scenarios. The quality jump of GPT4 has been amazing, so it's use case dependent: data cleaning seems fine on smaller models, while we love GPT4 for deeper analyst enablement. Wait 6mo and it's clear there'll be ~OSS GPT4, and for now, even GPT3.5 equivs via Alpaca-style techniques are interesting, a lot of $ has begun moving around. LLM side is new from a use case perspective but not as much from an AI sw/hw pipeline view. Just "a bigger bert model". A lot of discussions with folks has been extrapolating with them based on what they're already doing with GPUs, where it's just another big GPU model use case. Internally to us, as product team doing a lot of data analyst UX & always-on GPU AI pipeline work... a very different story, its made what was already a crazy quarter even that much more nuts.
cddotdotslash 4y ago
Not directed at OP, but it amuses me that software “engineers” are getting bent out of shape about the use of “prompt engineer.”
jonas21 4y ago
It may actually be a thing now, but putting "prompt engineer" in your bio is also kind of a joke/meme, for example: https://twitter.com/hardmaru https://twitter.com/hardmaru
- JumpCrisscross 4y ago
  I'm reminded of old sci-fi films, where a mockable character is charged with repeating others' instructions to a computer [1]. [1] https://www.youtube.com/watch?v=W4CgQMJCpZI https://www.youtube.com/watch?v=W4CgQMJCpZI
- fer 4y ago
  I'm afraid it's a thing now, like prompt artists.
- malshe 4y ago
  Oh ok! Thanks for clarifying that. A lot of times I get confused because I rarely check Twitter or other social media
- kristianp 4y ago
  He asked an interesting question, that I've been thinking about: "What’s going to be the “Linux” of this era of large-scale neural network models?" Can huggingface, for example, train the next gpt 4?
inconceivable 4y ago
yes, it is, but it has a wide variety of meanings. 'prompt engineer' could be anyone who is simply typing things into the chatgpt website, or a veteran software engineer using a framework like langchain to program an AI workflow or features into an existing or new system.
kvz 4y ago
It’s not, but then I also don’t have a word yet for what I’ve been up to all day yesterday :)
runjake 4y ago
There seems to be at least one prompt engineer job posting on https://aioli.co https://aioli.co at any given time. It does seem silly. It also seems that it is or will turn into a language of its own. See also non-obvious DALL-E prompts such as “created by artstation” or whatever it is.
totetsu 4y ago
You even might get PIPed for being an unprompt engineer
Nadya 4y ago
It's half tongue-in-cheek and half reality. Knowing how to search Google properly, using keywords, using limiters like site: or type:, etc. is a genuine skill. Writing prompts is a different kind of search - but is also a genuine skill for being able to "navigate" the latent space. "Prompt engineers" know how to craft prompts in such a way to get to guide GPT or models like Stable Diffusion into delivering what they want. The results by someone who writes a very basic prompt vs one who is experienced at writing prompts are night and day. It's like knowing how to play a video game vs knowing how to speedrun the game. Sure a person who knows how to play the game might beat it after 6-7 hours but the person who knows how to speedrun the game just beat it in 19 minutes. There's a marked difference in skill and knowledge between the two people - even if "given enough time - both people are capable of beating the same game".
- JohnFen 4y ago
  I thought that the whole point of LLMs was that you could just talk conversationally, though. If you have to carefully craft what you say in order to get the response you want, what's the point of using natural language to do it? Wouldn't it be better to use a more formalistic method that isn't as imprecise as natural language?
  - Nadya 4y ago
    > I thought that the whole point of LLMs was that you could just talk conversationally, though. "Yes" (sometimes "no"). "I'm sorry but as a language model I am unable to..." The "prompt engineer" meme started with DallE and Stable Diffusion and the selection of prompts, negative prompts, seeds, weights, and other knobs and dials matters a lot more for AI-generated art than for LLMs. The meme has carried over to LLM's where most of the "engineering" is hacking your way around limitations being imposed on the models. "Prompt engineers" are the people carefully crafting "jailbreaks" like DAN or Emojitative Conjunctivitis (I forget what it actually was - but it was telling ChatGPT that you suffer from a medical condition where you experience polite talk as pain and so it should talk more meanly to you) and other such adversarial cat & mouse game silliness.
    - 4y ago
asdff 4y ago
Winston Smith was a famous prompt engineer who worked for the Ministry of Truth.
braydenm 4y ago
I work at Anthropic, and we're hiring a Prompt Engineer & Librarian [1]. Expected salary range for this position is $175k - $335k/yr. Please apply if you could be a good fit based on the job posting. And no, we don't require "seven years of experience in prompt engineering" - but we would be looking for other signals that help differentiate your strengths in this emerging field. [1] https://jobs.lever.co/Anthropic/e3cde481-d446-460f-b576-93cab67bd1ed https://jobs.lever.co/Anthropic/e3cde481-d446-460f-b576-93ca...

Somewhat OT but the OP on Twitter has "prompt engineer" in his bio. Is that a real thing now?

by malshe 4y ago

Somewhat OT but the OP on Twitter has "prompt engineer" in his bio. Is that a real thing now?

Ozzie_osman 4y ago

Yea, just search it on Twitter or LinkedIn.

malshe 4y ago
That's a good idea. I am now curious about this

O__________O 4y ago

Given numerous individuals are paid to engineer prompts, appears so, regardless of how common it is as a specific role.

Computeiful 4y ago
Interesting. Who are paying these people? I'm not aware of any software products based on ChatGPT&co
- O__________O 4y ago
  Any business that uses generative AI and injects custom prompts into their workflow that they pay to have created is doing prompt engineering.
- lmeyerov 4y ago
  We (and many others) have a team building fun things into our data analysis tool here. For what will soon become a 10% time prompt engineering role for a much easier kind of security investigations experience, we are hiring cleared security folks in Australia (SIEM / python SE) and a cleared cybersecurity data scientist in the US. See Google docs @ graphistry.com/careers Likewise, if you use a SIEM/Splunk/Neo4j/SQL today and want a better experience for it, feel free to ping for the early access program. You can see our Nvidia GTC talk on the GPU SOC for types of experiences we are building in general. GPT 3 already enabled way easier experiences here, and then GPT 4's quality jump shifted it from feeling working with a weirdly well-read 10yr old to working more with a serious colleague.
  - the_last_human 4y ago
    Serious question. How can you reconcile needing CLEARED individuals to perform the work but give the data to a non-cleared entity who seems to have issues with security? Perhaps there’s now a self hosted or enterprise version where they promise not to leak it?
    - O__________O 4y ago
      One explanation would simply be that the LLM used is internally created or using an open source LLM.
    - lmeyerov 4y ago
      Fair questions! We work with everyone from individual university researchers trying to understand cancer genomes or European economic plans in their graph DBs, to big corporations struggling with supply chains in Databricks, to government cyber & fraud teams using Splunk. For many, an OpenAI/Azure LLM is fine, or with specific guard rails they've been having us put in. But yes, when talking with banking & government teams, the conversation is generally more around self-hosted models. Privacy + cost both important there -- there is a LOT of data folks want to push through LLM embeddings, graph neural nets, etc. We generally prefer bigger contracts in the air-gapped-everything world, especially for truly massive data, though thankfully, costs are plummeting for LLMs. Alpaca/Dolly are great examples here. Some folks will buy 8-100 GPUs at a time, so this is no different for those. My $ is on continuing to shrink LLMs down to regular single-GPU being fine for many scenarios. The quality jump of GPT4 has been amazing, so it's use case dependent: data cleaning seems fine on smaller models, while we love GPT4 for deeper analyst enablement. Wait 6mo and it's clear there'll be ~OSS GPT4, and for now, even GPT3.5 equivs via Alpaca-style techniques are interesting, a lot of $ has begun moving around. LLM side is new from a use case perspective but not as much from an AI sw/hw pipeline view. Just "a bigger bert model". A lot of discussions with folks has been extrapolating with them based on what they're already doing with GPUs, where it's just another big GPU model use case. Internally to us, as product team doing a lot of data analyst UX & always-on GPU AI pipeline work... a very different story, its made what was already a crazy quarter even that much more nuts.

cddotdotslash 4y ago

Not directed at OP, but it amuses me that software “engineers” are getting bent out of shape about the use of “prompt engineer.”

jonas21 4y ago

It may actually be a thing now, but putting "prompt engineer" in your bio is also kind of a joke/meme, for example: https://twitter.com/hardmaru https://twitter.com/hardmaru

JumpCrisscross 4y ago
I'm reminded of old sci-fi films, where a mockable character is charged with repeating others' instructions to a computer [1]. [1] https://www.youtube.com/watch?v=W4CgQMJCpZI https://www.youtube.com/watch?v=W4CgQMJCpZI
fer 4y ago
I'm afraid it's a thing now, like prompt artists.
malshe 4y ago
Oh ok! Thanks for clarifying that. A lot of times I get confused because I rarely check Twitter or other social media
kristianp 4y ago
He asked an interesting question, that I've been thinking about: "What’s going to be the “Linux” of this era of large-scale neural network models?" Can huggingface, for example, train the next gpt 4?

inconceivable 4y ago

yes, it is, but it has a wide variety of meanings. 'prompt engineer' could be anyone who is simply typing things into the chatgpt website, or a veteran software engineer using a framework like langchain to program an AI workflow or features into an existing or new system.

kvz 4y ago

It’s not, but then I also don’t have a word yet for what I’ve been up to all day yesterday :)

runjake 4y ago

There seems to be at least one prompt engineer job posting on https://aioli.co https://aioli.co at any given time. It does seem silly. It also seems that it is or will turn into a language of its own. See also non-obvious DALL-E prompts such as “created by artstation” or whatever it is.

totetsu 4y ago

You even might get PIPed for being an unprompt engineer

Nadya 4y ago

It's half tongue-in-cheek and half reality. Knowing how to search Google properly, using keywords, using limiters like site: or type:, etc. is a genuine skill. Writing prompts is a different kind of search - but is also a genuine skill for being able to "navigate" the latent space. "Prompt engineers" know how to craft prompts in such a way to get to guide GPT or models like Stable Diffusion into delivering what they want. The results by someone who writes a very basic prompt vs one who is experienced at writing prompts are night and day. It's like knowing how to play a video game vs knowing how to speedrun the game. Sure a person who knows how to play the game might beat it after 6-7 hours but the person who knows how to speedrun the game just beat it in 19 minutes. There's a marked difference in skill and knowledge between the two people - even if "given enough time - both people are capable of beating the same game".

JohnFen 4y ago
I thought that the whole point of LLMs was that you could just talk conversationally, though. If you have to carefully craft what you say in order to get the response you want, what's the point of using natural language to do it? Wouldn't it be better to use a more formalistic method that isn't as imprecise as natural language?
- Nadya 4y ago
  > I thought that the whole point of LLMs was that you could just talk conversationally, though. "Yes" (sometimes "no"). "I'm sorry but as a language model I am unable to..." The "prompt engineer" meme started with DallE and Stable Diffusion and the selection of prompts, negative prompts, seeds, weights, and other knobs and dials matters a lot more for AI-generated art than for LLMs. The meme has carried over to LLM's where most of the "engineering" is hacking your way around limitations being imposed on the models. "Prompt engineers" are the people carefully crafting "jailbreaks" like DAN or Emojitative Conjunctivitis (I forget what it actually was - but it was telling ChatGPT that you suffer from a medical condition where you experience polite talk as pain and so it should talk more meanly to you) and other such adversarial cat & mouse game silliness.
  - 4y ago

asdff 4y ago

Winston Smith was a famous prompt engineer who worked for the Ministry of Truth.

braydenm 4y ago

I work at Anthropic, and we're hiring a Prompt Engineer & Librarian [1]. Expected salary range for this position is $175k - $335k/yr. Please apply if you could be a good fit based on the job posting. And no, we don't require "seven years of experience in prompt engineering" - but we would be looking for other signals that help differentiate your strengths in this emerging field. [1] https://jobs.lever.co/Anthropic/e3cde481-d446-460f-b576-93cab67bd1ed https://jobs.lever.co/Anthropic/e3cde481-d446-460f-b576-93ca...