4 ms·
LLM Prompt Engineering: Injecting your own arbitrary data into a what is ultimately an undifferentiated input stream of word-tokens from no particular source, h
by Terr_ 2y ago
LLM Prompt Engineering: Injecting your own arbitrary data into a what is ultimately an undifferentiated input stream of word-tokens from no particular source, hoping your sequence will be most influential in the dream-generator output, compared to a sequence placed there by another person, or a sequence that they indirectly caused the system to emit that then got injected back into itself.
Then play whack-a-mole until you get what you want, enough of the time, temporarily.
- ljlolel 2y agosame as with asking humans to do something
- ImHereToVote 2y agoWhen we do prompt engineering for humans, we use the term Public Relations.
- manuelmoreale 2y agoThere’s also Social Engineering but I guess that’s a different thing :)
- TeMPOraL 2y agoNo, that's exactly the thing - it's prompt injection attacks on humans.
- Bluestein 2y ago... or - worse even - something you think is what you want, because you know not better, but happens to be a wholy (or - worse - even just subtly partially incorrect) confabulated answer.-
- brookst 2y agoAs a product manager this is largely my experience with developers.
- visarga 2y agoWe all use abstractions, and abstractions, good as they are to fight complexity, are also bad because sometimes they hide details we need to know. In other words, we don't genuinely understand anything. We're parrots of abstractions invented elsewhere and not fully grokked. In a company there is no single human who understands everything, it's a patchwork of partial understandings coupled functionally together. Even a medium sized git repo suffers from the same issue - nobody understands it fully.
- brookst 2y agoWholeheartedly agree. Which is why the most valuable people in a company are those who can cross abstraction layers, vertically or horizontally, and reduce information loss from boundaries between abstractions.
- Terr_ 2y agoWell, hopefully your developers are substantially more capable, able to clearly track the difference between your requests versus those of other stakeholders... And they don't get confused by overhearing their own voice repeating words from other people. :p
- criddell 2y agoIt probably shouldn't be called prompt engineering, even informally. The work of an engineer shouldn't require hope.
- sirspacey 2y agoThis is the fundamental change in the concept of programming From computer’s doing exactly what you state, with all the many challenges that creates To is probabilistically solving for your intent, with all the many challenges that creates Fair to say human beings probably need both to effectively communicate Will be interesting to see if the current GenAI + ML + prompt engineering + code is sufficient
- mplewis 2y agoNah man. This isn’t solving anything. This is praying to a machine god but it’s an autocomplete under the hood.
- Loughla 2y agoHonestly, this sort of programming (whether it's in quotes or not) will be unbelievably life changing when it works. I can absolutely put into words what I want, but I cannot program it because of all the variables. When a computer can build the code for me based on my description... Holy cow.
- VirusNewbie 2y agoif this doesn't work well with super high level languages, why would it work really well with LLMs?
- Loughla 2y agoI can have a conversation with LLM's. they can walk me through the troubleshooting without prior knowledge of programming languages. That seems like a massive advantage.
- deleted 2y ago