While they’re non-deterministic at a token level, they’re also still pattern following systems. Prompt Engineering is about (a) getting more deterministic outpu

While they’re non-deterministic at a token level, they’re also still pattern following systems. Prompt Engineering is about (a) getting more deterministic outputs from the model, (b) using the models’ own bias to get more useful output, (c) refining the prompt to shorten it and reduce costs at scale, and (d) using them as building blocks for higher-level functionality. As a disciple (if it can even be called that) it may very well disappear as the tech progresses. Edit to also say: you are correct that there are a lot of people selling secret sauce or magic techniques and those are pretty scammy.