3 ms·

I've noticed a very weird trend when trying to incorporate GPT4 into my workflow. I lead a small team of developers and security consultants, and whenever someo

by Genbox 4y ago

I've noticed a very weird trend when trying to incorporate GPT4 into my workflow. I lead a small team of developers and security consultants, and whenever someone runs into a problem, it is immediately searched for on the web. However, there is a real resistance/reluctance in using GPT for the same task. I think it is a combination of factors. The wrong answers are part of it, but I think another part is the anthropomorphization of it makes it almost like asking another human for help, which is somehow 'less good' than asking a search engine. For better or worse, LLMs are here to stay.

tomlagier 4y ago
For me, the reason I prefer Google to GPT is that it's much easier for me to assess the credibility of a Google answer vs a GPT one. There are so many signals in any primary source. Some obvious ones are things like number of upvotes, site reputability, presence of (working) examples, when was the answer written? More intangible things are like how closely does this solution match my problem statement, does the author write in a trustworthy manner are also easy for me to pick up at a glance. With GPT, I don't have any of that (or maybe I just need to re-learn it?) Also, I get a useful answer from most Google queries. GPT performs at a significantly lower bar (at least right now) - it works well for some stuff but not others, and the time it takes to figure out whether it's going to do a good job (and maybe do a couple of rounds of prompt refinement) is much more than just Googling.
- danielrpa 4y ago
  Bing Chat gives you references.
  - botanical 4y ago
    Except what it says isn't backed up by the references. It makes things up.
jhanschoo 4y ago
For me it's because I've been trained by decades of searching to type in only a few words to obtain a presumably relevant answer, whereas I think I have to write a mini-essay to ChatGPT to get an answer. But when I acquiesce to explaining to ChatGPT my information need, I get a more useful answer. (though frequently inaccurate in details)
never_inline 4y ago
> The wrong answers are part of it for me its wrong answers and long winded english sentences with low information density.

by Genbox 4y ago

tomlagier 4y ago

For me, the reason I prefer Google to GPT is that it's much easier for me to assess the credibility of a Google answer vs a GPT one. There are so many signals in any primary source. Some obvious ones are things like number of upvotes, site reputability, presence of (working) examples, when was the answer written? More intangible things are like how closely does this solution match my problem statement, does the author write in a trustworthy manner are also easy for me to pick up at a glance. With GPT, I don't have any of that (or maybe I just need to re-learn it?) Also, I get a useful answer from most Google queries. GPT performs at a significantly lower bar (at least right now) - it works well for some stuff but not others, and the time it takes to figure out whether it's going to do a good job (and maybe do a couple of rounds of prompt refinement) is much more than just Googling.

danielrpa 4y ago
Bing Chat gives you references.
- botanical 4y ago
  Except what it says isn't backed up by the references. It makes things up.

jhanschoo 4y ago

For me it's because I've been trained by decades of searching to type in only a few words to obtain a presumably relevant answer, whereas I think I have to write a mini-essay to ChatGPT to get an answer. But when I acquiesce to explaining to ChatGPT my information need, I get a more useful answer. (though frequently inaccurate in details)

never_inline 4y ago

> The wrong answers are part of it for me its wrong answers and long winded english sentences with low information density.