5 ms·

Recently I've used gpt 4 and yes it does take up to a minute even for easy questions. I've asked it how to scp a file on Windows 11 and it'll take a minute to

Recently I've used gpt 4 and yes it does take up to a minute even for easy questions. I've asked it how to scp a file on Windows 11 and it'll take a minute to tell me all the options possible. If this takes 1/5th the time for equivalent questions, I'd consider switching

joshspankit 3y ago
Not my experience at all. Are you counting the entire answer in your time? If so, consider adding one of the “just get to the point” prompts. GPT4’s defaults have been geared towards public acceptance through long-windedness which is imo entirely unnecessary when using it to do functional things like scp a file.
- londons_explore 3y ago
  The words "briefly" or "without explanation" work well. By keeping the prompt short, it starts generating output quicker too.
- phillipcarter 3y ago
  Yeah, I would say this is a prompting problem and not a model problem. In a product area we're building out right now with GPT-4, our prompt (more or less) tells it to provide exactly 3 values and it does that and only that. It's quite fast. Also, use case thing. It is very likely the case that for certain coding use cases, Phind will always be faster because it's not designed to be general purpose.
- theWreckluse 3y ago
  LOL, it’s not just for “public acceptance”. Look up Chain of Thought. Asking it to get to the point typically reduces the accuracy.
  - freedomben 3y ago
    > LOL, it’s not just for “public acceptance”. Look up Chain of Thought. Asking it to get to the point typically reduces the accuracy. Just trying to provide helpful feedback for you, this would have been a great comment, except for the "LOL" at the beginning that was unnecesary and demeaning.
  - bigfudge 3y ago
    You are being snarky but are right. I have scripts set up to auto summarise expansive answers. I wish I could build this into the ChatGPT ui though.
    - idonotknowwhy 3y ago
      Try the custom instructions feature
    - maccard 3y ago
      I know this is silly, but I've had great success asking chatgpt to summarise chatgpt's answers.
furyofantares 3y ago
This isn't a fair comparison because I have custom instructions that mention being brief but complete, but I did "how to scp a file on Windows 11" ChatGPT4: 14 seconds phind with "pair programmer" checked: 65 seconds phind default: 16 seconds
BugsJustFindMe 3y ago
> I've asked it how to scp a file on Windows 11 and it'll take a minute https://imgur.com/a/iqxOJUV https://imgur.com/a/iqxOJUV was 6.5 seconds. https://imgur.com/a/pQFfWli https://imgur.com/a/pQFfWli was 15. You can tell they're GPT-4 because the logo is purple (the logo is green when using 3.5).
heyodai 3y ago
Take a look at the AutoExpert custom instructions: https://github.com/spdustin/ChatGPT-AutoExpert https://github.com/spdustin/ChatGPT-AutoExpert It lets you specify verbosity from 1 to 5 (e.g. "V=1" in the prompt). Sometimes the model will just ignore that, but it actually does work most of the time. I use a verbosity of 1 or 2 when I just want a quick answer.

joshspankit 3y ago

Not my experience at all. Are you counting the entire answer in your time? If so, consider adding one of the “just get to the point” prompts. GPT4’s defaults have been geared towards public acceptance through long-windedness which is imo entirely unnecessary when using it to do functional things like scp a file.

londons_explore 3y ago
The words "briefly" or "without explanation" work well. By keeping the prompt short, it starts generating output quicker too.
phillipcarter 3y ago
Yeah, I would say this is a prompting problem and not a model problem. In a product area we're building out right now with GPT-4, our prompt (more or less) tells it to provide exactly 3 values and it does that and only that. It's quite fast. Also, use case thing. It is very likely the case that for certain coding use cases, Phind will always be faster because it's not designed to be general purpose.
theWreckluse 3y ago
LOL, it’s not just for “public acceptance”. Look up Chain of Thought. Asking it to get to the point typically reduces the accuracy.
- freedomben 3y ago
  > LOL, it’s not just for “public acceptance”. Look up Chain of Thought. Asking it to get to the point typically reduces the accuracy. Just trying to provide helpful feedback for you, this would have been a great comment, except for the "LOL" at the beginning that was unnecesary and demeaning.
- bigfudge 3y ago
  You are being snarky but are right. I have scripts set up to auto summarise expansive answers. I wish I could build this into the ChatGPT ui though.
  - idonotknowwhy 3y ago
    Try the custom instructions feature
  - maccard 3y ago
    I know this is silly, but I've had great success asking chatgpt to summarise chatgpt's answers.

furyofantares 3y ago

This isn't a fair comparison because I have custom instructions that mention being brief but complete, but I did "how to scp a file on Windows 11" ChatGPT4: 14 seconds phind with "pair programmer" checked: 65 seconds phind default: 16 seconds

BugsJustFindMe 3y ago

> I've asked it how to scp a file on Windows 11 and it'll take a minute https://imgur.com/a/iqxOJUV https://imgur.com/a/iqxOJUV was 6.5 seconds. https://imgur.com/a/pQFfWli https://imgur.com/a/pQFfWli was 15. You can tell they're GPT-4 because the logo is purple (the logo is green when using 3.5).

heyodai 3y ago

Take a look at the AutoExpert custom instructions: https://github.com/spdustin/ChatGPT-AutoExpert https://github.com/spdustin/ChatGPT-AutoExpert It lets you specify verbosity from 1 to 5 (e.g. "V=1" in the prompt). Sometimes the model will just ignore that, but it actually does work most of the time. I use a verbosity of 1 or 2 when I just want a quick answer.