6 ms·

I mean. Of course they are. Do you expect to be able to do any meaningful level of training on data that hasn't been properly labeled? At some point, a human ha

I mean. Of course they are. Do you expect to be able to do any meaningful level of training on data that hasn't been properly labeled? At some point, a human has to go in and correct the software when the software gets it wrong. If you want services that do what Google Home does, you have to have this. Even with that, I'm sure that the engineers are flagging voice requests that happen more then once, or where some one has to manually change or correct what the software thought was the request. This is only creepy if you don't understand how the software works.

inetknght 7y ago
> I'm sure that the engineers are flagging voice requests that happen more then once As a user, I expect to see feedback declaring that it's having trouble and specifically requesting permission to send my unparseable requests to some review queue. I expect to see feedback indicating what could resolve the issue: was it something I said? was there too much noise in the background? was there a software fault and a fix will be deployed at such-an-such date? The fact that I do not get any feedback whatsoever when things go wrong leads me to have no faith that the problem will be resolved in any satisfactory manner. When combined with a complete lack of consumer/business interaction options in general (w.r.t. Google), it leads to some very dissatisfied consumers. You think engineers are flagging voice requests that happen more than once? How would engineers have access to that data in the first place if it's supposed to be anonymous and private?
- RosanaAnaDana 7y ago
  >The fact that I do not get any feedback whatsoever when things go wrong leads me to have no faith that the problem will be resolved in any satisfactory manner. When combined with a complete lack of consumer/business interaction options in general (w.r.t. Google), it leads to some very dissatisfied consumers. I guess you can ask for your money back? Lets stay grounded in reality here, Google is paying money on your behalf to improve your experience. They could, and from a financial perspective maybe should try getting you to annotate your own data. But all that annotated data gets pooled and used to improve the models. I don't think their goal here is to give you faith they are resolving your issue. The algorithm is going to get some things wrong. Its a matter of improving the overall accuracy and precision in the algorithm. >You think engineers are flagging voice requests that happen more than once? How would engineers have access to that data in the first place if it's supposed to be anonymous and private? 100% they have to be. Its too costly and time intensive to slog through all the data. Probably* they have a flag that goes off on a voice request when something is either not intelligibly interpreted so many times in a row. Or if a use has to go manually do something after repeatedly making a request. This flags the interaction for manual review. Then it processes through some algorithm to strip it of identifying data. Then it gets put in front of a warm body for review. Trust me that the company wants to avoid putting things in front of warm bodies as much as possible. Its expensive.
  - close04 7y ago
    > Lets stay grounded in reality here, Google is paying money on your behalf to improve your experience. Lets stay grounded in reality here, Google is not doing this for me or on my behalf. Google just invests a bit to take a bunch of very valuable user data and then monetizes it for far more than it took to obtain it. This relies on the fact that most users are unaware of how valuable their data is. As a business model there's nothing illegal about this. But in any other sense it's no different from tricking an uneducated individual into selling their kidney for $2000 just so you can resell it for $20.000 and pretend you're doing them a favor by giving them money. And as long as the vast majority of customers are in the dark regarding the value of their data and what they're actually trading when using such a system then yes, this is Google (and not only) abusing ignorance to line their pockets.
    - greiskul 7y ago
      How do they monetize voice recognition data, other then by selling devices that use voice recognition, and trying to make them better for the user?
      - inetknght 7y ago
        Can you imagine how valuable voice data could be if it could be mined to show what products, politics, opinions are being discussed in the real world? Can you imagine how valuable your voice data would be to a marketing campaign which you didn't even know you had participated in? Can you imagine how much valuable information is contained in the vocal enunciation of A/B testing? Every little "hmmm" or "how do I go backwards?" or "what does this button do?" that people don't even realize they're saying. Can you imagine how much that violates someone's privacy?
      - close04 7y ago
        > other then by selling devices that use voice recognition That's one way but what's the actual question? My point is they are not doing this as a favor to the user (as GP seemed to suggest), they are doing it for a profit by getting the user's data far too cheaply. And for this they rely on the user staying unaware of the value of their data, how it will be used, and how much is collected in the first place. The voice recognition tech itself (and any ancillary parts) can be sold/licensed to so they can build similar systems. The actual data obtained by the voice recognition can be used exactly like any other data Google collects. They literally have access to what you say around their microphone. You can't not see any way they could make money from this. 20 years ago monetizing the free search was just as much of a mystery for many, including seasoned investors.
bassman9000 7y ago
It's precisely knowing how software works, and the limitations of the current technology, what makes it so creepy. With this system there's no way of avoiding humans hearing a clip they shouldn't have heard.
50656E6973 7y ago
>This is only creepy if you don't understand how the software works. No, its only creepy if you're not sure whether or not conversations had in the "privacy" of your own home are being listened to by a faceless person
- RosanaAnaDana 7y ago
  I mean. I don't have an always on system in my home. You don't have to use these services.
  - behringer 7y ago
    The devices have a mute switch and can be configured to beep when they begin recording. Really this is just a bunch of fear mongering going on.
    - einr 7y ago
      The devices have a mute switch Why would I trust that this does anything at all?
      - fwip 7y ago
        Because you can check. Open it up, see what it does. Use Wireshark to inspect traffic. More importantly, anyone can check, and many people have. Imagine the scoop that "the mute switch does nothing" would be for a tech journalist.
        einr 7y ago
        Here is a Google Home teardown: https://www.ifixit.com/Teardown/Google+Home+Teardown/72684 https://www.ifixit.com/Teardown/Google+Home+Teardown/72684 You will note that the mute button is not a physical switch that cuts the signal from the microphone, but a soft button. It will probably do what it claims most of the time, but if Google for whatever reason wanted to secretly unmute it remotely, I have no doubt they could. Wireshark? Sure, but what am I even looking for? They could be holding on to recordings in storage to send them later when the device is unmuted again. They could be embedding audio in encrypted form into other innocuous-looking packets -- I doubt a device like this is quiet on the network even when muted. Until all the software is open source and auditable and the switch verifiably breaks the physical signal path to the mic, a device like this can never be trusted.
tuxxy 7y ago
I feel like if you have to say, "It's only creepy if you don't know how the software worries" you're on the wrong side here. Regardless of how the software works, it's still incredibly creepy.
anbop 7y ago
How about Google PAY MONEY to generate training data or gather it from informed people? (“Make $100 by recording your voice for Google’s machine learning algorithms.”) not “Arms full with an infant? This $50 device will solve all your problems” and then shipping those recordings to third party contractors in unsecured facilities.
- duiker101 7y ago
  Why spend money when you can just use dark patterns? the backslash will probably be cheaper because the average customer doesn't care anyway!
- tbrownaw 7y ago
  Maybe if you get you training data by some very different source than your real data comes from, it won't be representative and won't work very well?
  - anbop 7y ago
    Figure out how to run your business unit ethically or shut down the business unit. They don’t have the right to turn their transfer learning problem into an abusive privacy policy.
  - thekyle 7y ago
    Yes, if they just paid people to record their voice they would not get training data for real use cases. I cannot find the blog post now, but quite a few years ago I recall some Google employees noticed a large number of queries for "cha cha cha cha cha..." from Android users in New York. All of the queries were done using voice search, so they listened to a few of the recordings. It turns out that their speech-to-text models were interpreting the sound of the NYC metro pulling into a station as speech. Obviously they didn't have enough training data of people trying to talk next to a train.
  - la_barba 7y ago
    We test our medicines on a small group that is representative of the entire worlds population. We build soil models based on sampling a small region. We don't test your entire blood to do a medical test. I don't know what you mean by "real data", but representative sampling is how work gets done in every single domain in the world. Google can do this.
matt_heimer 7y ago
It is still slightly creepy because of which humans are doing it. Is there any reason that these systems can't ask the users themselves about the accuracy of the speech to text conversion? Not everyone would do it but a percentage would.
noego 7y ago
I wonder how people felt about handing all their personal photos over to a stranger just so they can get developed and printed, back in the 1990s. By today's standards, that would be incredibly creepy. But everyone did it because... having photos is pretty awesome. It would be nice if companies like Google made it very clear that specific forms of user-data can/will be human reviewed for development/operational purposes. Personally, I just assume that anything I say after activating a digital assistant will be anonymized but listened to by a human one day. And I still think that Digital Home Assistants are pretty awesome despite that.
- duck 7y ago
  Photo labs have been around way before the 90's and lots of people still use them.
- pjc50 7y ago
  > I wonder how people felt about handing all their personal photos over to a stranger just so they can get developed and printed, back in the 1990s. By today's standards, that would be incredibly creepy. But everyone did it because... having photos is pretty awesome. This had its own set of norms associated with it: people would not take in photos that could be considered "indecent". Possibly by the extremely conservative standards of your local chemist. Then Polaroid invented a camera where you didn't have to submit your photos to the judging eye of someone else ...
  - bagacrap 7y ago
    What would they do with the indecent photos then?
    - pjc50 7y ago
      Not take them in the first place, develop them at home or a private lab, or use Polaroids.
      - the-rc 7y ago
Der_Einzige 7y ago
Uhhhhh??????? Unsupervised learning is totally a thing! Word embedding models are achieving STOA results on massive unlabeled corpuses. That's what's powering most of the new results in NLP. Clustering and Dimensionality Reduction folks just sitting here thrown out to dry too...
- anticensor 7y ago
  Unsupervised learning is even more black-boxy than supervised learning in terms of explainability.
- RosanaAnaDana 7y ago
  Oh man. You should let Google know this so they can stop wasting money by paying people to label your data.

inetknght 7y ago

> I'm sure that the engineers are flagging voice requests that happen more then once As a user, I expect to see feedback declaring that it's having trouble and specifically requesting permission to send my unparseable requests to some review queue. I expect to see feedback indicating what could resolve the issue: was it something I said? was there too much noise in the background? was there a software fault and a fix will be deployed at such-an-such date? The fact that I do not get any feedback whatsoever when things go wrong leads me to have no faith that the problem will be resolved in any satisfactory manner. When combined with a complete lack of consumer/business interaction options in general (w.r.t. Google), it leads to some very dissatisfied consumers. You think engineers are flagging voice requests that happen more than once? How would engineers have access to that data in the first place if it's supposed to be anonymous and private?

RosanaAnaDana 7y ago
>The fact that I do not get any feedback whatsoever when things go wrong leads me to have no faith that the problem will be resolved in any satisfactory manner. When combined with a complete lack of consumer/business interaction options in general (w.r.t. Google), it leads to some very dissatisfied consumers. I guess you can ask for your money back? Lets stay grounded in reality here, Google is paying money on your behalf to improve your experience. They could, and from a financial perspective maybe should try getting you to annotate your own data. But all that annotated data gets pooled and used to improve the models. I don't think their goal here is to give you faith they are resolving your issue. The algorithm is going to get some things wrong. Its a matter of improving the overall accuracy and precision in the algorithm. >You think engineers are flagging voice requests that happen more than once? How would engineers have access to that data in the first place if it's supposed to be anonymous and private? 100% they have to be. Its too costly and time intensive to slog through all the data. Probably* they have a flag that goes off on a voice request when something is either not intelligibly interpreted so many times in a row. Or if a use has to go manually do something after repeatedly making a request. This flags the interaction for manual review. Then it processes through some algorithm to strip it of identifying data. Then it gets put in front of a warm body for review. Trust me that the company wants to avoid putting things in front of warm bodies as much as possible. Its expensive.
- close04 7y ago
  > Lets stay grounded in reality here, Google is paying money on your behalf to improve your experience. Lets stay grounded in reality here, Google is not doing this for me or on my behalf. Google just invests a bit to take a bunch of very valuable user data and then monetizes it for far more than it took to obtain it. This relies on the fact that most users are unaware of how valuable their data is. As a business model there's nothing illegal about this. But in any other sense it's no different from tricking an uneducated individual into selling their kidney for $2000 just so you can resell it for $20.000 and pretend you're doing them a favor by giving them money. And as long as the vast majority of customers are in the dark regarding the value of their data and what they're actually trading when using such a system then yes, this is Google (and not only) abusing ignorance to line their pockets.
  - greiskul 7y ago
    How do they monetize voice recognition data, other then by selling devices that use voice recognition, and trying to make them better for the user?
    - inetknght 7y ago
      Can you imagine how valuable voice data could be if it could be mined to show what products, politics, opinions are being discussed in the real world? Can you imagine how valuable your voice data would be to a marketing campaign which you didn't even know you had participated in? Can you imagine how much valuable information is contained in the vocal enunciation of A/B testing? Every little "hmmm" or "how do I go backwards?" or "what does this button do?" that people don't even realize they're saying. Can you imagine how much that violates someone's privacy?
    - close04 7y ago
      > other then by selling devices that use voice recognition That's one way but what's the actual question? My point is they are not doing this as a favor to the user (as GP seemed to suggest), they are doing it for a profit by getting the user's data far too cheaply. And for this they rely on the user staying unaware of the value of their data, how it will be used, and how much is collected in the first place. The voice recognition tech itself (and any ancillary parts) can be sold/licensed to so they can build similar systems. The actual data obtained by the voice recognition can be used exactly like any other data Google collects. They literally have access to what you say around their microphone. You can't not see any way they could make money from this. 20 years ago monetizing the free search was just as much of a mystery for many, including seasoned investors.

bassman9000 7y ago

It's precisely knowing how software works, and the limitations of the current technology, what makes it so creepy. With this system there's no way of avoiding humans hearing a clip they shouldn't have heard.

50656E6973 7y ago

>This is only creepy if you don't understand how the software works. No, its only creepy if you're not sure whether or not conversations had in the "privacy" of your own home are being listened to by a faceless person

RosanaAnaDana 7y ago
I mean. I don't have an always on system in my home. You don't have to use these services.
- behringer 7y ago
  The devices have a mute switch and can be configured to beep when they begin recording. Really this is just a bunch of fear mongering going on.
  - einr 7y ago
    The devices have a mute switch Why would I trust that this does anything at all?
    - fwip 7y ago
      Because you can check. Open it up, see what it does. Use Wireshark to inspect traffic. More importantly, anyone can check, and many people have. Imagine the scoop that "the mute switch does nothing" would be for a tech journalist.
      - einr 7y ago
        Here is a Google Home teardown: https://www.ifixit.com/Teardown/Google+Home+Teardown/72684 https://www.ifixit.com/Teardown/Google+Home+Teardown/72684 You will note that the mute button is not a physical switch that cuts the signal from the microphone, but a soft button. It will probably do what it claims most of the time, but if Google for whatever reason wanted to secretly unmute it remotely, I have no doubt they could. Wireshark? Sure, but what am I even looking for? They could be holding on to recordings in storage to send them later when the device is unmuted again. They could be embedding audio in encrypted form into other innocuous-looking packets -- I doubt a device like this is quiet on the network even when muted. Until all the software is open source and auditable and the switch verifiably breaks the physical signal path to the mic, a device like this can never be trusted.

tuxxy 7y ago

I feel like if you have to say, "It's only creepy if you don't know how the software worries" you're on the wrong side here. Regardless of how the software works, it's still incredibly creepy.

anbop 7y ago

How about Google PAY MONEY to generate training data or gather it from informed people? (“Make $100 by recording your voice for Google’s machine learning algorithms.”) not “Arms full with an infant? This $50 device will solve all your problems” and then shipping those recordings to third party contractors in unsecured facilities.

duiker101 7y ago
Why spend money when you can just use dark patterns? the backslash will probably be cheaper because the average customer doesn't care anyway!
tbrownaw 7y ago
Maybe if you get you training data by some very different source than your real data comes from, it won't be representative and won't work very well?
- anbop 7y ago
  Figure out how to run your business unit ethically or shut down the business unit. They don’t have the right to turn their transfer learning problem into an abusive privacy policy.
- thekyle 7y ago
  Yes, if they just paid people to record their voice they would not get training data for real use cases. I cannot find the blog post now, but quite a few years ago I recall some Google employees noticed a large number of queries for "cha cha cha cha cha..." from Android users in New York. All of the queries were done using voice search, so they listened to a few of the recordings. It turns out that their speech-to-text models were interpreting the sound of the NYC metro pulling into a station as speech. Obviously they didn't have enough training data of people trying to talk next to a train.
- la_barba 7y ago
  We test our medicines on a small group that is representative of the entire worlds population. We build soil models based on sampling a small region. We don't test your entire blood to do a medical test. I don't know what you mean by "real data", but representative sampling is how work gets done in every single domain in the world. Google can do this.

matt_heimer 7y ago

It is still slightly creepy because of which humans are doing it. Is there any reason that these systems can't ask the users themselves about the accuracy of the speech to text conversion? Not everyone would do it but a percentage would.

noego 7y ago

I wonder how people felt about handing all their personal photos over to a stranger just so they can get developed and printed, back in the 1990s. By today's standards, that would be incredibly creepy. But everyone did it because... having photos is pretty awesome. It would be nice if companies like Google made it very clear that specific forms of user-data can/will be human reviewed for development/operational purposes. Personally, I just assume that anything I say after activating a digital assistant will be anonymized but listened to by a human one day. And I still think that Digital Home Assistants are pretty awesome despite that.

duck 7y ago
Photo labs have been around way before the 90's and lots of people still use them.
pjc50 7y ago
> I wonder how people felt about handing all their personal photos over to a stranger just so they can get developed and printed, back in the 1990s. By today's standards, that would be incredibly creepy. But everyone did it because... having photos is pretty awesome. This had its own set of norms associated with it: people would not take in photos that could be considered "indecent". Possibly by the extremely conservative standards of your local chemist. Then Polaroid invented a camera where you didn't have to submit your photos to the judging eye of someone else ...
- bagacrap 7y ago
  What would they do with the indecent photos then?
  - pjc50 7y ago
    Not take them in the first place, develop them at home or a private lab, or use Polaroids.
    - the-rc 7y ago

Der_Einzige 7y ago

Uhhhhh??????? Unsupervised learning is totally a thing! Word embedding models are achieving STOA results on massive unlabeled corpuses. That's what's powering most of the new results in NLP. Clustering and Dimensionality Reduction folks just sitting here thrown out to dry too...

anticensor 7y ago
Unsupervised learning is even more black-boxy than supervised learning in terms of explainability.
RosanaAnaDana 7y ago
Oh man. You should let Google know this so they can stop wasting money by paying people to label your data.