6 ms·

I dunno, I recently learned about how the Toyota Synergy Drive system works in detail. Despite being the type of person who'd be interested in that kind of thin

I dunno, I recently learned about how the Toyota Synergy Drive system works in detail. Despite being the type of person who'd be interested in that kind of thing I thought it was not generally well understood, I've only come across one website which described it in detail. I asked ChatGPT about it and it game me a fairly surface level answer. I then asked it for more details and it went into detail far beyond what the average person would be able to tell you. I thought that was quite impressive for a fairly obscure bit of mechanical engineering.

karpierz 4y ago
Out of curiosity, I'd have the following questions: 1. Would you be able to notice if it made something up, given that it's going beyond the detail that you know? 2. Did it have any details that aren't covered in: https://en.wikipedia.org/wiki/Hybrid_Synergy_Drive https://en.wikipedia.org/wiki/Hybrid_Synergy_Drive
- hooande 4y ago
  what exactly do you think its going to make up? "The Hybrid Synergy Drive runs on apples and fairy dust"? I doubt that OP wants to build one of the engines, they just want a concise explanation. I've seen gpt hallucinate all kinds of things. But very rarely for something like explaining a process or system.
  - svachalek 4y ago
    It writes things that sound reasonable in context. So it will likely give something that sounds like a Popular Mechanics article about how some kind of machine works, but it may not really be this particular machine that you are asking about, or any actual machine in existence. That's the tricky thing about it, if it actually said "fairy dust" you know you can stop reading, but what it actually writes typically needs some actual understanding of the subject to refute.
webstrand 4y ago
In my experience from asking it questions about things that I know well, the deeper you get into the weeds with it, the more likely it is to invent some kind of extremely plausible-sounding but incorrect answer. How confident are you that what it told you is actually correct?
- tempest_ 4y ago
  That is the one thing I think about when people say "I used it to learn X and it was very good" but when people are learning they are not in a position to to judge if what they learned is correct. A lot of other stuff is just regurgitation of a wiki article. Still it is very interesting and definitely a step forward.
  - beepbooptheory 4y ago
    And then we must remember that wiki articles themselves can also be quite wrong.
- broast 4y ago
  That's what I like to use it for. To come up with plausible answers for questions that people don't have correct answers for yet, and then probe the reasons behind it. It can be very creative and insightful in such uses.
  - logifail 4y ago
    > It can be very creative and insightful in such uses I once worked with a very smart woman who at that time worked in marketing for the airside retail stores at a large international airport. If anyone from outside her immediate sphere asked her what she did, she would typically say "I tell lies for a living".
  - webstrand 4y ago
    Yep, this is how I've been using it too. The responses I get are often good starting points for further investigation. Often it comes up with better terms to find the answer that I am seeking than I had originally.
andrepd 4y ago
Well it's essentially a (good) search engine then, isn't it? Somebody somewhere wrote that description, and chatgpt understood your query and fetched it.
- dsr_ 4y ago
  A good search engine gives you references you can read, because they exist.
enragedcacti 4y ago
> Despite being the type of person who'd be interested in that kind of thing I thought it was not generally well understood Its an extremely well understood piece of technology and has been for decades outside of Toyota. Here is a 2005 paper that accurately models the fundamental behavior of the Prius HSD [1]. There are dozens of pages that explain it in various detail, including ones with live simulators of the power split device. [2] There are tons of forum threads of amateur Prius owners chatting about the internals. I don't say this as a dunk, but to point out that a person's perception of chatGPT's capabilities are heavily influenced by their familiarity with the domain. [1] https://www.engr.uvic.ca/~mech459/Pub_References/01500979.pdf https://www.engr.uvic.ca/~mech459/Pub_References/01500979.pd... [2] http://eahart.com/prius/psd/ http://eahart.com/prius/psd/
- VBprogrammer 4y ago
  I think you and I have different definitions of not generally well understood. I would be impressed if more than 1 in 1000 people could describe it to the level of "it's a planetary gearbox with 2 electric motors used as inputs and outputs to control the effective gear ratio".
  - logifail 4y ago
    > I would be impressed if more than 1 in 1000 people could describe it Q: What use is it attempting to measure ChatGPT's capabilities on something vs the average person on the street, or vs the average user with access to google.com? What does that actually tell us? Maybe I'm showing my age, but if one wanted to learn or discover something, wouldn't one first typically try and find a reliable source/expert in that field or subject?
  - enragedcacti 4y ago
    ahh, I misunderstood what you meant. In that case can you explain to me why its meaningful that chatGPT can sometimes explain things for which there are tons of resources online to learn about them but that a lot of people aren't familiar with? I legitimately just don't understand why that is an interesting bar to clear, especially given that it can also unpredictably lie about some aspects of the thing its explaining. It would perhaps be interesting if it were such a hard topic that only 1 in 1000 could be capable of understanding it, but I would hazard a guess that most people familiar with the prius who don't understand its drivetrain probably don't understand it because they don't care, not because its too complicated to understand.
bamboozled 4y ago
Because it’s really trained off datasets you’d have access too via search engine, if you couldn’t find the info yourself, it’s likely just making a lot of the answers up, convincingly
swatcoder 4y ago
That's exactly the wrong sort of thing to turn to ChatGPT for. In probing it for more detail, you're giving it increasingly helpful hints on how to answer your questions in a way that makes you satisfied, regardless of accuracy. That's what it's optimized to do. And because you're working from a humble and curious understanding of the topic yourself, it can and will make up all sorts of things that make you believe its insightful because you want to believe it. It's the same technique a stage psychic uses to demonstrate that they knew all about your late uncle and his peculiar love of ducks.
- darkwater 4y ago
  GP stated that they asked ChatGPT about a topic they already were familiar with, from other sources. And that the answer made sense.
  - Retric 4y ago
    ChatGPT is optimized to seem to make sense, it’s like talking to a world class con artist you won’t notice it’s talking nonsense. Thus is subtly dangerous in ways that aren’t obvious in the beginning. Sure it seems great at writing boilerplate code, unfortunately it’s really good and writing the kind of bugs that you don’t notice. This is maddening in a completely novel way, like working with an actively malicious autocomplete.
    - 2devnull 4y ago
      You can verify it’s accuracy. The metaphor of “con artist” is a poor one. It has no adversarial interest. A con artist does. Furthermore, con stands for confidence. A con artist manipulates confidence. Gpt and other language models are “what it says on the tin.” Not understanding the fallibility of LLM is not the fault of the technology. It’s the user’s fault. Not at all like a con artist. More like a tool that can be dangerous in the hands of the uneducated. That is a very large set of human tools, from nuclear reaction to pharmaceuticals to the automobile. Perhaps we just need “drivers ed” for large language models.

karpierz 4y ago

Out of curiosity, I'd have the following questions: 1. Would you be able to notice if it made something up, given that it's going beyond the detail that you know? 2. Did it have any details that aren't covered in: https://en.wikipedia.org/wiki/Hybrid_Synergy_Drive https://en.wikipedia.org/wiki/Hybrid_Synergy_Drive

hooande 4y ago
what exactly do you think its going to make up? "The Hybrid Synergy Drive runs on apples and fairy dust"? I doubt that OP wants to build one of the engines, they just want a concise explanation. I've seen gpt hallucinate all kinds of things. But very rarely for something like explaining a process or system.
- svachalek 4y ago
  It writes things that sound reasonable in context. So it will likely give something that sounds like a Popular Mechanics article about how some kind of machine works, but it may not really be this particular machine that you are asking about, or any actual machine in existence. That's the tricky thing about it, if it actually said "fairy dust" you know you can stop reading, but what it actually writes typically needs some actual understanding of the subject to refute.

webstrand 4y ago

In my experience from asking it questions about things that I know well, the deeper you get into the weeds with it, the more likely it is to invent some kind of extremely plausible-sounding but incorrect answer. How confident are you that what it told you is actually correct?

tempest_ 4y ago
That is the one thing I think about when people say "I used it to learn X and it was very good" but when people are learning they are not in a position to to judge if what they learned is correct. A lot of other stuff is just regurgitation of a wiki article. Still it is very interesting and definitely a step forward.
- beepbooptheory 4y ago
  And then we must remember that wiki articles themselves can also be quite wrong.
broast 4y ago
That's what I like to use it for. To come up with plausible answers for questions that people don't have correct answers for yet, and then probe the reasons behind it. It can be very creative and insightful in such uses.
- logifail 4y ago
  > It can be very creative and insightful in such uses I once worked with a very smart woman who at that time worked in marketing for the airside retail stores at a large international airport. If anyone from outside her immediate sphere asked her what she did, she would typically say "I tell lies for a living".
- webstrand 4y ago
  Yep, this is how I've been using it too. The responses I get are often good starting points for further investigation. Often it comes up with better terms to find the answer that I am seeking than I had originally.

andrepd 4y ago

Well it's essentially a (good) search engine then, isn't it? Somebody somewhere wrote that description, and chatgpt understood your query and fetched it.

dsr_ 4y ago
A good search engine gives you references you can read, because they exist.

enragedcacti 4y ago

> Despite being the type of person who'd be interested in that kind of thing I thought it was not generally well understood Its an extremely well understood piece of technology and has been for decades outside of Toyota. Here is a 2005 paper that accurately models the fundamental behavior of the Prius HSD [1]. There are dozens of pages that explain it in various detail, including ones with live simulators of the power split device. [2] There are tons of forum threads of amateur Prius owners chatting about the internals. I don't say this as a dunk, but to point out that a person's perception of chatGPT's capabilities are heavily influenced by their familiarity with the domain. [1] https://www.engr.uvic.ca/~mech459/Pub_References/01500979.pdf https://www.engr.uvic.ca/~mech459/Pub_References/01500979.pd... [2] http://eahart.com/prius/psd/ http://eahart.com/prius/psd/

VBprogrammer 4y ago
I think you and I have different definitions of not generally well understood. I would be impressed if more than 1 in 1000 people could describe it to the level of "it's a planetary gearbox with 2 electric motors used as inputs and outputs to control the effective gear ratio".
- logifail 4y ago
  > I would be impressed if more than 1 in 1000 people could describe it Q: What use is it attempting to measure ChatGPT's capabilities on something vs the average person on the street, or vs the average user with access to google.com? What does that actually tell us? Maybe I'm showing my age, but if one wanted to learn or discover something, wouldn't one first typically try and find a reliable source/expert in that field or subject?
- enragedcacti 4y ago
  ahh, I misunderstood what you meant. In that case can you explain to me why its meaningful that chatGPT can sometimes explain things for which there are tons of resources online to learn about them but that a lot of people aren't familiar with? I legitimately just don't understand why that is an interesting bar to clear, especially given that it can also unpredictably lie about some aspects of the thing its explaining. It would perhaps be interesting if it were such a hard topic that only 1 in 1000 could be capable of understanding it, but I would hazard a guess that most people familiar with the prius who don't understand its drivetrain probably don't understand it because they don't care, not because its too complicated to understand.

bamboozled 4y ago

Because it’s really trained off datasets you’d have access too via search engine, if you couldn’t find the info yourself, it’s likely just making a lot of the answers up, convincingly

swatcoder 4y ago

That's exactly the wrong sort of thing to turn to ChatGPT for. In probing it for more detail, you're giving it increasingly helpful hints on how to answer your questions in a way that makes you satisfied, regardless of accuracy. That's what it's optimized to do. And because you're working from a humble and curious understanding of the topic yourself, it can and will make up all sorts of things that make you believe its insightful because you want to believe it. It's the same technique a stage psychic uses to demonstrate that they knew all about your late uncle and his peculiar love of ducks.

darkwater 4y ago
GP stated that they asked ChatGPT about a topic they already were familiar with, from other sources. And that the answer made sense.
- Retric 4y ago
  ChatGPT is optimized to seem to make sense, it’s like talking to a world class con artist you won’t notice it’s talking nonsense. Thus is subtly dangerous in ways that aren’t obvious in the beginning. Sure it seems great at writing boilerplate code, unfortunately it’s really good and writing the kind of bugs that you don’t notice. This is maddening in a completely novel way, like working with an actively malicious autocomplete.
  - 2devnull 4y ago
    You can verify it’s accuracy. The metaphor of “con artist” is a poor one. It has no adversarial interest. A con artist does. Furthermore, con stands for confidence. A con artist manipulates confidence. Gpt and other language models are “what it says on the tin.” Not understanding the fallibility of LLM is not the fault of the technology. It’s the user’s fault. Not at all like a con artist. More like a tool that can be dangerous in the hands of the uneducated. That is a very large set of human tools, from nuclear reaction to pharmaceuticals to the automobile. Perhaps we just need “drivers ed” for large language models.