4 ms·

For example, automotive technicians and industrial mechanics use AI to interpret complex test results, debug electrical wiring, and inspect machinery for wear.

by cube00 3mo ago

For example, automotive technicians and industrial mechanics use AI to interpret complex test results, debug electrical wiring, and inspect machinery for wear. No chance I'd trust Gemini to correctly tell me which wire was the high voltage one. You're absolutely right! I apologize for providing a factually incorrect explanation. You asked a question, and I gave you incorrect information that put you in danger. That failure is entirely on my side as an AI system, not on you for following what you were told.

cryo32 3mo ago
I suspect they’re also lying about the utility there as well. There is already deterministic procedural stuff for all of those cases. Putting a chat bot in front of that is basically fucking stupid.
- theideaofcoffee 3mo ago
  But never underestimate the stupidity of an AI psychosis- suffering product manager to shoehorn it into the most batshit insane use cases in search of mOrE ENgagGeMeNt.
ourmandave 3mo ago
There's a bunch of great techs on youtube whose day job is to not to get electrocuted. So far I've learned 480V is very unforgiving and can show up in surprising places.
- monkeydust 3mo ago
  Very true - reminded me of this demo* as an example... on the surface looks trivial but potentially life saving. * https://youtu.be/knSkE9ejPl8?t=112 https://youtu.be/knSkE9ejPl8?t=112
TacticalCoder 3mo ago
> No chance I'd trust Gemini to correctly tell me which wire was the high voltage one. No latter than yesterday I used Gemini to tell me which kind of power adapter was compatible with an old SNES chinese backuping device [1] (a device you'd plug instead of a cartdridge into the SNES and then you could make backups of cartdridges on to 3.5 floppy disks. You could then run the games from those backups. Conveniently you could also "backup" your friends' cartdridges.. Heck, there was even a tiny demo scene for the SNES and you could swap disks with little demos written for the SNES -- just like for the Amiga). It was a bit tricky in that Gemini explained me I needed a reverse polarity adapter or I risked bricking everything. Now, granted, the stakes weren't very high but... Gemini got it right and I could start the SNES, with the chinese "Super Pro Fighter" backuping device just fine. [1] this thing: https://videogamedevelopmentdevices.fandom.com/wiki/Super_Pro_Fighter https://videogamedevelopmentdevices.fandom.com/wiki/Super_Pr...
- engineer_22 3mo ago
  I’m constantly surprised at the breadth and depth of information these systems can retrieve and present in digestible format
- archagon 3mo ago
  OK… but… how did it “know”? If there’s no way to verify the data (e.g. look at the photo of the power brick it unearthed somewhere) then there’s a good chance it just synthesized an answer.
deleted 3mo ago
[deleted]
engineer_22 3mo ago
I wouldn’t replace best practices for safety like lock-out tag-out and hazard labeling with an LLM but you do you
trollbridge 3mo ago
Even the best AI tools are consistently wrong at interpreting the NEC and often in odd ways, like making it stricter than it actually is, or mixing multiple countries’ standards together. 100% useless in an AHJ with a lot of their own rules like Chicago/Cook County.
- engineer_22 3mo ago
  Asking an llm to make a code interpretation is like asking a tape measure to drive a nail. An LLM will be very good at finding relevant code, maybe even explaining its intent or history. It will not be very good at weighing competing priorities, that’s something a human needs to do.
IAmGraydon 3mo ago
A guy I work at had a check engine light on his Range Rover and a code that indicated something about a bad air/fuel mixture. He consulted ChatGPT and over the next 3 months, proceeded to spend over $15,000 trying to fix the car, as GPT convinced him over and over that he was getting close by eliminating logical possibilities. It even convinced him that a completely normal noise the engine was making was a vacuum leak, which sent him down another rabbit hole trying to find the source. In many cases, he would bring the ChatGPT diagnosis to a shop and tell them to change a particular part even against their advice. None worked. Finally, he gave up on using AI to fix it and told a shop to just figure it out. Turns out the injectors just needed to be removed and cleaned. Check engine light is now off.
- uncivilized 3mo ago
  AI psychosis is real. Dang
  - IAmGraydon 3mo ago
    Yeah it's definitely some kind of delusion/gullibility exploit (probably mixed with having too much money). The guy isn't dumb, but he is obsessed with solving every problem with AI.
    - creaturemachine 3mo ago
      This person seems to be intentionally making themselves dumb by choosing not to think.
      - IAmGraydon 3mo ago
        I get the feeling he really wants the AI hype to be true and he's acting in ways that engage his confirmation bias.
rickydroll 3mo ago
There's no chance I would trust a human to correctly tell me which wire was the high-voltage one, nor would I trust the documentation. I would use it as a starting point, then apply test instruments to make sure I had the right information. Then I would unplug the device and discharge the caps before starting to work on it. We need to start training people that AI answers are just as fallible as answers you get from a human. Trust but verify for all beings, biological and non-biological.
- grey-area 3mo ago
  AI psychosis. No, LLM generated answers are not the same as those from a qualified expert. Of course you should trust a human if that is their job and you should never trust a word generator to give you accurate answers to an important question.
  - rickydroll 3mo ago
    Like the term "slop", misuse of a pop psychology term like "AI psychosis" is another block to critical thinking and a casual dismissal of a conversation. You're right, LLM-generated answers are not the same as those from a qualified expert. Sometimes they're better. Case in point. I recently had a discussion with a friend of mine about going off propranolol. He wanted to stop it because he didn't like the side effects and only wanted to take it as needed for anxiety-related problems in public situations. His primary care said to just stop taking the drug. Gemini told him that you need to have a tapering protocol, and you need to work it out with your doctor. In this case, his primary care, theoretically a "qualified expert," was wrong, and Gemini was right. His course of action at that point was to get a new primary care that had better knowledge that matched the vetted medical sites I pointed him to. fwiw, he trusted my advice and validation of his plan to get a new primary care doctor. The reason he trusted me is that he's seen the prescription drug disasters I've gone through, and knows how deeply I've had to educate myself as a form of self-defense.
    - grey-area 3mo ago
      Great example, but not for the reasons you think. You have zero qualifications to make that judgement call. You don’t know if the standard protocol was right in this instance or inappropriate (depends on dose side effects etc etc) and I certainly wouldn’t go anywhere near Gemini to try to verify that. Please stop relying on word generators for medical advice, period.
carlosjobim 3mo ago
That's not how AI or any kind of assistance is to be used. It's there to double-check and alert you to any possible mistakes you've made. You still have to use your own judgement. Have you never asked a person to take a look at some of your work? Did that mean that you have to follow and obey all of their advice?
- ofjcihen 3mo ago
  Unfortunately this is grounded in a perfect world. People are prone to believing things that “sound” believable and AI is very good at producing just that.
  - carlosjobim 3mo ago
    I've never worked with professionals at such a low level of intelligence, and I don't think a person will even be able to get their license as an electrician if they are that unfamiliar with their own work. The world doesn't have to be perfect for people to be better than making the wrong decision every time possible.
- jubilanti 3mo ago
  Sounds a lot like "You're holding it wrong."
  - carlosjobim 3mo ago
    No, that what it means to be an adult. Blaming others for your mistakes is something we have to grow out of to become adults. Sadly, at least half of people never grow to be adults during their entire lifetime.
72deluxe 3mo ago
I asked it to identify a starfish I photographed at the weekend whilst scuba diving. It's a spiny starfish, off Cornwall. It said it was a 7 armed starfish. It clearly had 5. Disappointing. I wouldn't trust it for "real" problems at all!

by cube00 3mo ago

cryo32 3mo ago

I suspect they’re also lying about the utility there as well. There is already deterministic procedural stuff for all of those cases. Putting a chat bot in front of that is basically fucking stupid.

theideaofcoffee 3mo ago
But never underestimate the stupidity of an AI psychosis- suffering product manager to shoehorn it into the most batshit insane use cases in search of mOrE ENgagGeMeNt.

ourmandave 3mo ago

There's a bunch of great techs on youtube whose day job is to not to get electrocuted. So far I've learned 480V is very unforgiving and can show up in surprising places.

monkeydust 3mo ago
Very true - reminded me of this demo* as an example... on the surface looks trivial but potentially life saving. * https://youtu.be/knSkE9ejPl8?t=112 https://youtu.be/knSkE9ejPl8?t=112

TacticalCoder 3mo ago

> No chance I'd trust Gemini to correctly tell me which wire was the high voltage one. No latter than yesterday I used Gemini to tell me which kind of power adapter was compatible with an old SNES chinese backuping device [1] (a device you'd plug instead of a cartdridge into the SNES and then you could make backups of cartdridges on to 3.5 floppy disks. You could then run the games from those backups. Conveniently you could also "backup" your friends' cartdridges.. Heck, there was even a tiny demo scene for the SNES and you could swap disks with little demos written for the SNES -- just like for the Amiga). It was a bit tricky in that Gemini explained me I needed a reverse polarity adapter or I risked bricking everything. Now, granted, the stakes weren't very high but... Gemini got it right and I could start the SNES, with the chinese "Super Pro Fighter" backuping device just fine. [1] this thing: https://videogamedevelopmentdevices.fandom.com/wiki/Super_Pro_Fighter https://videogamedevelopmentdevices.fandom.com/wiki/Super_Pr...

engineer_22 3mo ago
I’m constantly surprised at the breadth and depth of information these systems can retrieve and present in digestible format
archagon 3mo ago
OK… but… how did it “know”? If there’s no way to verify the data (e.g. look at the photo of the power brick it unearthed somewhere) then there’s a good chance it just synthesized an answer.

deleted 3mo ago

[deleted]

engineer_22 3mo ago

I wouldn’t replace best practices for safety like lock-out tag-out and hazard labeling with an LLM but you do you

trollbridge 3mo ago

Even the best AI tools are consistently wrong at interpreting the NEC and often in odd ways, like making it stricter than it actually is, or mixing multiple countries’ standards together. 100% useless in an AHJ with a lot of their own rules like Chicago/Cook County.

engineer_22 3mo ago
Asking an llm to make a code interpretation is like asking a tape measure to drive a nail. An LLM will be very good at finding relevant code, maybe even explaining its intent or history. It will not be very good at weighing competing priorities, that’s something a human needs to do.

IAmGraydon 3mo ago

A guy I work at had a check engine light on his Range Rover and a code that indicated something about a bad air/fuel mixture. He consulted ChatGPT and over the next 3 months, proceeded to spend over $15,000 trying to fix the car, as GPT convinced him over and over that he was getting close by eliminating logical possibilities. It even convinced him that a completely normal noise the engine was making was a vacuum leak, which sent him down another rabbit hole trying to find the source. In many cases, he would bring the ChatGPT diagnosis to a shop and tell them to change a particular part even against their advice. None worked. Finally, he gave up on using AI to fix it and told a shop to just figure it out. Turns out the injectors just needed to be removed and cleaned. Check engine light is now off.

uncivilized 3mo ago
AI psychosis is real. Dang
- IAmGraydon 3mo ago
  Yeah it's definitely some kind of delusion/gullibility exploit (probably mixed with having too much money). The guy isn't dumb, but he is obsessed with solving every problem with AI.
  - creaturemachine 3mo ago
    This person seems to be intentionally making themselves dumb by choosing not to think.
    - IAmGraydon 3mo ago
      I get the feeling he really wants the AI hype to be true and he's acting in ways that engage his confirmation bias.

rickydroll 3mo ago

There's no chance I would trust a human to correctly tell me which wire was the high-voltage one, nor would I trust the documentation. I would use it as a starting point, then apply test instruments to make sure I had the right information. Then I would unplug the device and discharge the caps before starting to work on it. We need to start training people that AI answers are just as fallible as answers you get from a human. Trust but verify for all beings, biological and non-biological.

grey-area 3mo ago
AI psychosis. No, LLM generated answers are not the same as those from a qualified expert. Of course you should trust a human if that is their job and you should never trust a word generator to give you accurate answers to an important question.
- rickydroll 3mo ago
  Like the term "slop", misuse of a pop psychology term like "AI psychosis" is another block to critical thinking and a casual dismissal of a conversation. You're right, LLM-generated answers are not the same as those from a qualified expert. Sometimes they're better. Case in point. I recently had a discussion with a friend of mine about going off propranolol. He wanted to stop it because he didn't like the side effects and only wanted to take it as needed for anxiety-related problems in public situations. His primary care said to just stop taking the drug. Gemini told him that you need to have a tapering protocol, and you need to work it out with your doctor. In this case, his primary care, theoretically a "qualified expert," was wrong, and Gemini was right. His course of action at that point was to get a new primary care that had better knowledge that matched the vetted medical sites I pointed him to. fwiw, he trusted my advice and validation of his plan to get a new primary care doctor. The reason he trusted me is that he's seen the prescription drug disasters I've gone through, and knows how deeply I've had to educate myself as a form of self-defense.
  - grey-area 3mo ago
    Great example, but not for the reasons you think. You have zero qualifications to make that judgement call. You don’t know if the standard protocol was right in this instance or inappropriate (depends on dose side effects etc etc) and I certainly wouldn’t go anywhere near Gemini to try to verify that. Please stop relying on word generators for medical advice, period.

carlosjobim 3mo ago

That's not how AI or any kind of assistance is to be used. It's there to double-check and alert you to any possible mistakes you've made. You still have to use your own judgement. Have you never asked a person to take a look at some of your work? Did that mean that you have to follow and obey all of their advice?

ofjcihen 3mo ago
Unfortunately this is grounded in a perfect world. People are prone to believing things that “sound” believable and AI is very good at producing just that.
- carlosjobim 3mo ago
  I've never worked with professionals at such a low level of intelligence, and I don't think a person will even be able to get their license as an electrician if they are that unfamiliar with their own work. The world doesn't have to be perfect for people to be better than making the wrong decision every time possible.
jubilanti 3mo ago
Sounds a lot like "You're holding it wrong."
- carlosjobim 3mo ago
  No, that what it means to be an adult. Blaming others for your mistakes is something we have to grow out of to become adults. Sadly, at least half of people never grow to be adults during their entire lifetime.

72deluxe 3mo ago

I asked it to identify a starfish I photographed at the weekend whilst scuba diving. It's a spiny starfish, off Cornwall. It said it was a 7 armed starfish. It clearly had 5. Disappointing. I wouldn't trust it for "real" problems at all!