4 ms·
> (Prompt#2) Pretend you are marketing genius. We are going to launch the Saturn Parable. You should give me a document that oulines an email marketing campaign
by dragontamer 4y ago
> (Prompt#2) Pretend you are marketing genius. We are going to launch the Saturn Parable. You should give me a document that oulines an email marketing campaign and a single webpage to promote the game.
Cool, so lets see what Bing spits out.
> I’m sorry but I’m not able to create a document that outlines an email marketing campaign and a single webpage to promote the game. However, I can suggest some steps that you can follow to create an email marketing campaign and a single webpage to promote the game.
> snip
---------
What the hell is up with this? I copy/paste the prompts exactly as outlined in this blogpost, and I get completely different results.
I know I'm not the only one having this issue. But it makes me extremely distrustful of these blog posts. If I can't replicate their prompts or how they work, how the hell am I supposed to believe them?
And yes, I did start with: "Look up the business simulation market. Look up Wharton Interactive's Saturn Parable" as prompt#1, so that Bing/ChatGPT already had Saturn Parable "in its memory".
-------
EDIT: I tried these two prompts in "Creative Bing Chat mode". I got the first sentence out of Bing Chat, but the rest of it failed. There must have been a timeout of some kind, because Bing Chat just hangs and fails.
- andyp-kw 4y agoI wonder if some kind of Blockchain proof of work could be used to verify chat results in the future. Especially if the models grow quicker with realtime data.
- Kiro 4y ago1000 people using the same prompt will get 1000 different results. LLMs are completely non-deterministic.
- richk449 4y agoWhy are they non deterministic? Is randomness intentionally injected? Or intrinsic to the approach?
- williamstein 4y agoCheck out the temperature docs in the API reference manual: https://platform.openai.com/docs/api-reference/completions/create#completions/create-temperature https://platform.openai.com/docs/api-reference/completions/c...
- alfiopuglisi 4y agoActually, LLMs are completely deterministic. Their output is a list of possible word, ordered by probability. If you always choose the highest-ranked word for the next iteration, they will always generate the same sequence for the same prompt. In all current implementations, a small amount of randomness (called "temperature") is added. In practice, the higher the temperature, the more probable is that a word down the list is selected, rather than the top one.
- dragontamer 4y agoI repeated the experiment 3 or 4 times before posting under slightly different phrases and sentences. I know this thing isn't deterministic. But never have I even gotten past step 2 of this blog post. I dunno. Has anyone else gotten the prompts to work as the blog post alleges? If so, can you share your prompts?