3 ms·

I think ChatGPT is just bad at whatever domain you have expertise in. Talk to it about something you don't know about, and you'll think it's really good techno

by mrkeen 2y ago

I think ChatGPT is just bad at whatever domain you have expertise in. Talk to it about something you don't know about, and you'll think it's really good technology ;)

pwg 2y ago
So it shows an electronic form of Gell-Mann Amnesia?: https://www.epsilontheory.com/gell-mann-amnesia/ https://www.epsilontheory.com/gell-mann-amnesia/
- dagmx 2y ago
  Ah thanks for the link. I’ve been trying to recall the name of the phenomena for ages and it’s always been just on the tip of my tongue.
deleted 2y ago
[deleted]
Yawrehto 2y ago
"Everything you read in the newspapers is absolutely true except for the rare story of which you happen to have firsthand knowledge." - Erwin Knoll, allegedly[1] [1] It's widely attested to him, including on Wikipedia and in an aside in an old NYTimes article [https://www.nytimes.com/1982/02/27/us/required-reading-smith-on-lawyers.html https://www.nytimes.com/1982/02/27/us/required-reading-smith...], but I couldn't track down the original source to verify it. It's possible it's falsely attributed, but on the other hand he wasn't super prominent -- editor of a major magazine for progressivism, called The Progressive, yes, but no Mark Twain -- and so there'd be little incentive to say it was his when you could call it Twain's.
more_corn 2y ago
It’s pretty good at code for my job. Maybe my job is just easy. But I have a couple decades of experience at it and it’s able to generate reasonably good code for obscure parts of what I do. I saw a spectacularly bad example of open ai trying to reason about electronics yesterday. Something like how do I use the gpio pins of my jetson and it failed so hard it was funny. That one seems simple to me. Identify that you need to look up the pinouts, find the image. Label the pins… I suspect there’s something wrong in this generation of gpts when it comes to reasoning about electronics.
anonzzzies 2y ago
It is pretty good at coding; I have 40+ years of hobby and professional experience of coding in dozens of languages, from small projects to millions of lines architected and (co) written by me. There is software I wrote begin 90s still running production etc. I am a cto now but I still write code for my job about half time and in my free time as well, that is to say, I was until recently; now I have the tooling (made myself as I didn't like what there was at the time) to not code at all and yet I produce more code than ever. We use PRs and reviews and my colleagues are quite surprised about the speed and the quality. So yeah, not bad for sure even in my field of expertise. We are now rolling out my tooling in the company so everyone can forget about the boring stuff and just focus on the business logic. There is resistance as this is going to cost jobs; we don't have infinite work to do and this is much (much) faster.
- b20000 2y ago
  the last 1% of a project takes as much time as the first 99% of a project
  - anonzzzies 2y ago
    And this is related to my comment how?
    - skydhash 2y ago
      The code is the mean, not the end. And you take care in it, because other people will work with it to handle changing requirements. One aspect of seniority is to know the tools to solve a problem, the other is to make the solution practical to maintain and adaptive. And this takes as much time as solving the problem.
      - anonzzzies 2y ago
        I agree, still not really related to a thread that is about llms writing code. The llm and code are tools to address stuff my business deals with; I didn't say it does everything; we were just talking about the code part.

by mrkeen 2y ago

I think ChatGPT is just bad at whatever domain you have expertise in. Talk to it about something you don't know about, and you'll think it's really good technology ;)

pwg 2y ago

So it shows an electronic form of Gell-Mann Amnesia?: https://www.epsilontheory.com/gell-mann-amnesia/ https://www.epsilontheory.com/gell-mann-amnesia/

dagmx 2y ago
Ah thanks for the link. I’ve been trying to recall the name of the phenomena for ages and it’s always been just on the tip of my tongue.

deleted 2y ago

[deleted]

Yawrehto 2y ago

"Everything you read in the newspapers is absolutely true except for the rare story of which you happen to have firsthand knowledge." - Erwin Knoll, allegedly[1] [1] It's widely attested to him, including on Wikipedia and in an aside in an old NYTimes article [https://www.nytimes.com/1982/02/27/us/required-reading-smith-on-lawyers.html https://www.nytimes.com/1982/02/27/us/required-reading-smith...], but I couldn't track down the original source to verify it. It's possible it's falsely attributed, but on the other hand he wasn't super prominent -- editor of a major magazine for progressivism, called The Progressive, yes, but no Mark Twain -- and so there'd be little incentive to say it was his when you could call it Twain's.

more_corn 2y ago

It’s pretty good at code for my job. Maybe my job is just easy. But I have a couple decades of experience at it and it’s able to generate reasonably good code for obscure parts of what I do. I saw a spectacularly bad example of open ai trying to reason about electronics yesterday. Something like how do I use the gpio pins of my jetson and it failed so hard it was funny. That one seems simple to me. Identify that you need to look up the pinouts, find the image. Label the pins… I suspect there’s something wrong in this generation of gpts when it comes to reasoning about electronics.

anonzzzies 2y ago

It is pretty good at coding; I have 40+ years of hobby and professional experience of coding in dozens of languages, from small projects to millions of lines architected and (co) written by me. There is software I wrote begin 90s still running production etc. I am a cto now but I still write code for my job about half time and in my free time as well, that is to say, I was until recently; now I have the tooling (made myself as I didn't like what there was at the time) to not code at all and yet I produce more code than ever. We use PRs and reviews and my colleagues are quite surprised about the speed and the quality. So yeah, not bad for sure even in my field of expertise. We are now rolling out my tooling in the company so everyone can forget about the boring stuff and just focus on the business logic. There is resistance as this is going to cost jobs; we don't have infinite work to do and this is much (much) faster.

b20000 2y ago
the last 1% of a project takes as much time as the first 99% of a project
- anonzzzies 2y ago
  And this is related to my comment how?
  - skydhash 2y ago
    The code is the mean, not the end. And you take care in it, because other people will work with it to handle changing requirements. One aspect of seniority is to know the tools to solve a problem, the other is to make the solution practical to maintain and adaptive. And this takes as much time as solving the problem.
    - anonzzzies 2y ago
      I agree, still not really related to a thread that is about llms writing code. The llm and code are tools to address stuff my business deals with; I didn't say it does everything; we were just talking about the code part.