3 ms·

> then ChatGPT is very likely to answer questions about it accurately. Uh, and sooo boringly, especially if there's even any tiny part of it that is developing

> then ChatGPT is very likely to answer questions about it accurately. Uh, and sooo boringly, especially if there's even any tiny part of it that is developing or theoretical, and you want to learn about that part. I've used the phrase/request "more obscure (perspectives/explanations/etc)" with GPT so many times. (Try it, you might be surprised at alternative takes on things, takes which are not even necessarily conspiracy theories and such) ...Which has made me think: Maybe life is more boring, the more one thinks there are just really good one-and-done answers to most everything.

simonw 3y ago
Yeah, there are so many fun ways you can make it more interesting. One of my favourite is to ask it to explain with analogies. The other day I was digging into the attention mechanism used to train LLMs, so I asked it: "Explain queries, keys, and values in the context of LLM attention using analogies from Terry Pratchett's Discworld" I find sometimes I get some real gems out of this that help me remember things much more effectively than just reading the basic explanation. (In case anyone's curious I ran that just now and got the following: https://gist.github.com/simonw/777b1d19f36beb39fb4216a0238fec13 https://gist.github.com/simonw/777b1d19f36beb39fb4216a0238fe... )
barrysteve 3y ago
Jonathan Blow is spending up to a decade on a new programming language to get away from c++. Most everything has been covered in logical extensions of concepts started in the 80s-90s. Those products aren't good for our.. Ah there's no point commenting here anymore. HN is so blinkered in it's thinking. The feeling of flying high on lofty concepts and pretending to get a bird's eye view of tech is no longer worth the squeeze. The thought patterns here are predictable like slashdot. I don't belong here. Bye.
- themodelplumber 3y ago
  Yep, if you don't care about the details or scope, everything is the same, all patterns repeat, all wheels are reinvented. You've probably heard this before, but IMO you'll never find a happy place working from that perspective.
CGamesPlay 3y ago
Try switching to the OpenAI playground in the API console. You can adjust the system prompt and the temperature of the response. Higher temperatures = less predictable responses.
- themodelplumber 3y ago
  Thanks for the tip. I set it to 1 and still get the same effect...like should this affect e.g. book recommendations? Recommend 10 project gutenberg books that are fun to read --> same old stuff--Huck Finn, Robinson Crusoe, War of the Worlds. But I'm not sure if this particular use is really a temperature-relevant thing or not.

simonw 3y ago

Yeah, there are so many fun ways you can make it more interesting. One of my favourite is to ask it to explain with analogies. The other day I was digging into the attention mechanism used to train LLMs, so I asked it: "Explain queries, keys, and values in the context of LLM attention using analogies from Terry Pratchett's Discworld" I find sometimes I get some real gems out of this that help me remember things much more effectively than just reading the basic explanation. (In case anyone's curious I ran that just now and got the following: https://gist.github.com/simonw/777b1d19f36beb39fb4216a0238fec13 https://gist.github.com/simonw/777b1d19f36beb39fb4216a0238fe... )

barrysteve 3y ago

Jonathan Blow is spending up to a decade on a new programming language to get away from c++. Most everything has been covered in logical extensions of concepts started in the 80s-90s. Those products aren't good for our.. Ah there's no point commenting here anymore. HN is so blinkered in it's thinking. The feeling of flying high on lofty concepts and pretending to get a bird's eye view of tech is no longer worth the squeeze. The thought patterns here are predictable like slashdot. I don't belong here. Bye.

themodelplumber 3y ago
Yep, if you don't care about the details or scope, everything is the same, all patterns repeat, all wheels are reinvented. You've probably heard this before, but IMO you'll never find a happy place working from that perspective.

CGamesPlay 3y ago

Try switching to the OpenAI playground in the API console. You can adjust the system prompt and the temperature of the response. Higher temperatures = less predictable responses.

themodelplumber 3y ago
Thanks for the tip. I set it to 1 and still get the same effect...like should this affect e.g. book recommendations? Recommend 10 project gutenberg books that are fun to read --> same old stuff--Huck Finn, Robinson Crusoe, War of the Worlds. But I'm not sure if this particular use is really a temperature-relevant thing or not.