4 ms·

I've found that Google's chat thing is wrong 90% of the time with coding questions. Yesterday I asked how to "crop" a geopandas dataframe to a specific area of

I've found that Google's chat thing is wrong 90% of the time with coding questions. Yesterday I asked how to "crop" a geopandas dataframe to a specific area of interest, a lat/lng box, and it told me to use a dataframe function that's not even in the API. The "highest probability string" is useless if it's just dead wrong.

thfuran 3y ago
The remarkable thing about the current llms is that they're usable at all. For as much pushback as the idea seems to get, they really are a lot more like Markov chain generators than expert systems.
robbrown451 3y ago
I've had very different results. ChatGPT today is like a backhoe compared to a team of human with shovels. You still need a person who knows how to operate it, and their skills are different from those who dig with shovels. A bad backhoe operator is worse than any number of humans with shovels. Pretty soon it will be able to learn by running its own code and testing it by looking at its output, including with its "vision."
- cjohnson318 3y ago
  > I've had very different results. That is very interesting. I can't think of a single time the Google built-in LLM has worked for me, let alone surprised and delighted me with a technical answer. I'm sure it's great at a lot of things, but it's not a replacement for SO yet.
  - robbrown451 3y ago
    Oh sorry you said Google. Yes I am speaking of ChatGPT, and I pay for GPT-4. It surprises and delights me on a regular basis. I have no doubt Google will catch up, but right now I think OpenAI is far out front.
    - airstrike 3y ago
      Same. GPT-4 is amazing for a majority of coding tasks I throw at it.
    - cjohnson318 3y ago
      I paid for ChatGPT for a while, but it was hit or miss with some Django stuff. I tried Copilot for the first time today, and I was absolutely blown away. I swear it's like it was reading my mind. I guess I wasn't feeding ChatGPT enough context.
  - oezi 3y ago
    With ChatGPT-4 I have stopped Googling and using SO for 95% of all programming related queries. ChatGPT not only gets my specific problem but can produce workable code in many cases.

thfuran 3y ago

The remarkable thing about the current llms is that they're usable at all. For as much pushback as the idea seems to get, they really are a lot more like Markov chain generators than expert systems.

robbrown451 3y ago

I've had very different results. ChatGPT today is like a backhoe compared to a team of human with shovels. You still need a person who knows how to operate it, and their skills are different from those who dig with shovels. A bad backhoe operator is worse than any number of humans with shovels. Pretty soon it will be able to learn by running its own code and testing it by looking at its output, including with its "vision."

cjohnson318 3y ago
> I've had very different results. That is very interesting. I can't think of a single time the Google built-in LLM has worked for me, let alone surprised and delighted me with a technical answer. I'm sure it's great at a lot of things, but it's not a replacement for SO yet.
- robbrown451 3y ago
  Oh sorry you said Google. Yes I am speaking of ChatGPT, and I pay for GPT-4. It surprises and delights me on a regular basis. I have no doubt Google will catch up, but right now I think OpenAI is far out front.
  - airstrike 3y ago
    Same. GPT-4 is amazing for a majority of coding tasks I throw at it.
  - cjohnson318 3y ago
    I paid for ChatGPT for a while, but it was hit or miss with some Django stuff. I tried Copilot for the first time today, and I was absolutely blown away. I swear it's like it was reading my mind. I guess I wasn't feeding ChatGPT enough context.
- oezi 3y ago
  With ChatGPT-4 I have stopped Googling and using SO for 95% of all programming related queries. ChatGPT not only gets my specific problem but can produce workable code in many cases.