7 ms·

For Chat-Based AI, We Are All Once Again Tech Companies’ Guinea Pigs

58 points by gibsonf1 4y ago

simonster 4y ago
In modern society, we prioritize the ease of bringing new products to market over regulation and testing. The only industry we prospectively regulate for safety is the pharmaceutical industry. Otherwise, regulation is retrospective and slow. Look at the way we regulate harmful chemicals. After studies find that chemicals found in consumer products are harmful, manufacturers spend several years redesigning their products to avoid them. After manufacturers have voluntarily redesigned their products, the chemicals are banned. The manufacturers often replace the harmful chemicals with structurally similar chemicals that have not yet been shown to be harmful. When those similar chemicals are shown to be harmful, the cycle repeats. This is the history of phthalates, which are used to soften PVC plastic. The CPSC first considered banning one phthalate (DEHP) in children's toys the 1980s. Before that happened, all large manufacturers replaced it by another phthalate (DINP), which also turned out to be harmful. Both DEHP and DINP were finally banned by congressional action in 2008. Technology is not a chemical, but anything that people will be spending significant time interacting with is likely to have some effect on their wellbeing, potentially small but potentially large, potentially positive but potentially negative. The type of harms these chatbots might cause are difficult to predict in advance. It could take a couple years to determine whether the current generation of chatbots are actually a net positive or negative for society. In that time, they may become too entrenched for us to do anything if they do turn out to be harmful. When Facebook first came out, I doubt many people foresaw the negative impact that it could have on teenagers. Today, many studies show that social media use has a negative impact on kids' wellbeing, but there is no going back to a pre-social media world. Prospectively testing and regulating tech in the same way we regulate pharma seems insane. OTOH, we do want to make sure that world-changing tech actually changes the world for the better, and the only obvious way to do this is through some kind of regulation. Although regulation will undoubtedly slow growth, many of us would be happy to sacrifice some growth for improved wellbeing. At this point, everyone has seen the productivity-pay gap plot showing that most of the improvement in US productivity since 1979 has not translated into increases in real wages. Our current "growth at almost any cost" strategy benefits corporations much more than it benefits the average person.
catchnear4321 4y ago
Always have been. (This case is just more conspicuous.)
skilled 4y ago
https://archive.is/W3qCe https://archive.is/W3qCe
- jeleh 4y ago
  thanks! :+1!
elicash 4y ago
People aren't worried about hurting themselves with AI, they're expressing that other people are too dumb or irresponsible to use it properly. I'm less sympathetic to this concern. Not totally dismissive. I think some of the restrictions are fair for a company running a business. If you want to sell to other companies, make sure your bots don't use racial slurs, for example. But I don't think there's an ethical issue.
- osigurdson 4y ago
  Yes, the persistent MAD argument (masses are dumb). It’s ok for the smart me but not for dumb others. Sorry, normal distribution does not agree.
  - omnicognate 4y ago
    There's no correlation between intelligence and likelihood of being hoodwinked by this stuff afaict. The human biases involved are universal and plenty of very smart people are publicly attributing to it capabilities it doesn't possess. I've used it enough to know it has no utility for me. I don't expect my world to be improved by others using it, and I think there's a strong chance it will be made materially worse. That doesn't mean I think it should be banned, that the people that invented it have done something immoral or that I'm smarter than anyone else.
- SpicyLemonZest 4y ago
  I'm absolutely worried about hurting myself with AI. I don't think you or I or anyone else is smart enough to avoid falling for AI-generated misinformation at scale.
epups 4y ago
> Eliminating made-up information and bias from chat-based search engines is impossible given the current state of the technology, says Mark Riedl, a professor at Georgia Institute of Technology who studies artificial intelligence. He believes the release of these technologies to the public by Microsoft and OpenAI is premature. “We are putting out products that are still being actively researched at this moment,” he adds. As far as I can tell, this is the gist of the article, which I find boring. When Google started, its main product was still being actively researched - heck, it was the result of an algorithm from two grad students. You definitely had and still have made-up and biased results there too. Yet it was an incredibly useful technology.
- kevingadd 4y ago
  Google listing search results that are unverified is a little different from an AI confidently answering a question wrong in English prose, isn't it? Only one of them is asserting truth.
  - Kamq 4y ago
    > Only one of them is asserting truth. Have any of these companies actually asserted any truth around these models? I mean, the model itself asserts a bunch of truth, but I have a lot of books that confidently assert truths that are completely wrong (fiction), and it hasn't caused many problems. This seems more like it depends very much on how the product is framed. If these companies are claiming that the models are completely accurate, they should definitely be hit for some kind of fraud, but I haven't actually seen that. The closest I've seen is companies claiming that they could be useful (and based on comments here, I think that's quite justified).
  - Robotbeat 4y ago
    Not really. In fact with Google it could be worse as it can unknowingly lead you to a fake site (spammer site meant to look like an official government website, for instance), whereas ChatGPT gives you explicit acknowledgement when you log in that a lot of the stuff it says is fake, plus it is clear you’re chatting with an AI.
mistrial9 4y ago
"we" ?! appeal to populism, from the trade journal of top hats and Pinkertons. knee-jerk disdain aside.. Even the lofty towers of Finance and their close companions Legal, are feeling the hot breath of AI creatures it seems. They are right to be alarmed, for it is within their own ranks that the most unexpected and treacherous uses of this tech will occur. Sure, some salesman in San Francisco claims that he can sell ads to a Billion South Asians, but "we" all know that it is in the inches of legal documents, and public fiduciary statements, that things will get really messy, really quickly. Bye bye venture capitalist club -- you were raging tigers and you will tear yourselves into bloody bits in front of everyone.
- bigger_inside 4y ago
  I enjoyed this comment. A judge in Colombia said he used chatGPT: https://forogpp.com/2023/02/03/a-judge-in-cartagena-colombia-claims-to-have-use-chatgpt-as-support-tool-to-resolve-a-guardianship-for-health-care-neglect/ https://forogpp.com/2023/02/03/a-judge-in-cartagena-colombia... own ranks? treacherous use? check? When automation came for factory workers, the exploiters cheered. When it came for the service jobs, the exploiters cheered. When it comes for the knowledge workers.. well, the exploiters will still cheer, just that the bullshit job class (https://www.atlasofplaces.com/essays/on-the-phenomenon-of-bullshit-jobs/ https://www.atlasofplaces.com/essays/on-the-phenomenon-of-bu...) will suddenly realize that they were never a part of the exploiter class to being with. They were just servants convinced that they were, like Heinrich Popitz' deck chair guardians on the cruise ship...
- RandomLensman 4y ago
  It will be interesting to see if AI will be accepted to provide the more "theological" services of high priced consultants and advisers.
ThrowawayTestr 4y ago
"for horseless-carriages, we are all once again tech companies' guinea pigs"
- kevingadd 4y ago
  Considering how many people get killed by cars every day and how they reshaped American society I'm not sure how to interpret this analogy.
melling 4y ago
Sounds good. Let’s get the technology over the finish line. The future is behind schedule.
- MonkeyClub 4y ago
  > The future is behind schedule. This reminds me of the old 2600 crowd poster of "1984 - we're behind schedule". I don't think this quick find[1] is the original poster, as I seem to remember it referencing the Secret Service rather than the NSA, but it sure does capture the whole idea well enough. [1] https://steemitimages.com/DQmTEZ3U2U5DrgXDax5wmvaXvWa7rKyaS8kpsGLwRmGppX7/image.png https://steemitimages.com/DQmTEZ3U2U5DrgXDax5wmvaXvWa7rKyaS8...
  - melling 4y ago
    I don’t remember that one. People love to reach for the dystopian future point of view. I do remember 20 years ago the ad nauseam complaints about tracking cell phones. Then 7-8 years ago we had the complaints about Amazon Alexa. I’m simply talking about millions of people essentially crowdsourcing a solution. It’s more valuable than wasting all that time complaining about AI
karaterobot 4y ago
Seriously, someone should stop OpenAI from hijacking people's browsers to make them go to ChatGPT. And I also agree that it's evil of Microsoft to leverage its wildly popular Bing and Edge platforms — which we were already all totally using — and insert this malicious AI into it. And all without any repeated, near-constant warning that this is a beta project that should not be trusted. This was forced on us, and not something that went virally popular and got people excited to try it.
- xg15 4y ago
  I mean for a short while I was actually dreading that one day my Word would auto update and I'd be greeted by Clippy again - Microsoft's initial press statements while the ChatGPT hype was at its peak did sound a bit as if they were scrambling to stuff ChatGPT in as many products as possible before any competitor could make a move. But I think by now, Bing aka Sydney has made a very convincing case to Microsoft that this would be a very bad idea.
flandish 4y ago
Well yeah. If it’s free, you’re the product. Socialize the research and the risk, privatize the profit and future.
- MonkeyClub 4y ago
  > If it’s free, you’re the product. Be careful when using this phrase around here, it's a sure-fire way to get grayed out to obscurity. There seems to be a subset of HNers who take offense every time they encounter it, because it's a "platitude". That doesn't make it any less true, though :)
  - flandish 4y ago
    I don’t disagree - the usual cohort here is people looking for that extra “capitalist help” with the whole “bootstraps” marketing angle popular these days. And you’re right: doesn’t make it less true. I suppose in the gpt space it may be “if it’s free, you’re the QC phase.”
- ThrowawayTestr 4y ago
  How is Microsoft giving openai 10 billion dollars "socializing the research"?
  - flandish 4y ago
    That’s not what I spoke of. I stated “if it’s free.” Don’t mix up direction and order of operations here. MS “giving” is an investment. GPT being free to use (us) is also a form of investment. Look at healthcare. Govs (taxpayers) funded research into vaccines that then … get returned to profit to corporations. Not to lowering of taxes.
ergonaught 4y ago
Companies wouldn't ship prematurely and broken if consumers/customers cared enough to stop using them. Scale, network effects, etc, have all come together to ensure that this essentially never occurs. Worse, really, people will passionately and irrationally defend garbage. The "first mover advantage" and such is a reality created by consumer/customer behavior, not by "tech" companies using the world as a pool of beta testers.
- roflyear 4y ago
  People who are fanboys of these massive companies are so weird to me.
  - ergonaught 4y ago
    Huh?
    - roflyear 4y ago
      Being a fanboy of a company like Google is just weird to me.
- ergonaught 4y ago
  The downvotes this received amplify my fear for the future of this species.
jillesvangurp 4y ago
What a load of alarmist nonsense. Who is the royal "we" in this article's title? Clueless Wall Street Journal reading "victims"? Or just curious people that signed up for this. I believe it's the latter. If you don't want it, don't sign up for it, or opt in. Refrain from using it. Very simple.
- pixl97 4y ago
  Right, just like 'we' can avoid pollution and traffic from automobiles....
- varelse 4y ago
  [dead]
- manimino 4y ago
  Yep. Standard clickbait formula, stir up emotions, add no new information. So easy an AI could do it.
- politician 4y ago
  “We” refers to the WSJ hive mind of employees. In the dark ages before ChatGPT, the only access individuals had to large language models was through the editing process that newsrooms use to harness the power of dozens of human brains. These archaic processes had severe bandwidth limitations that prevented the level of individualized interaction that we all benefit from today.
- rnosov 4y ago
  I think it's "we" as in "real humans" vs them "AI chatbots". It would be easy to avoid them at the moment but might be a lot harder in the future (in a way it becomes difficult to use physical cash in many parts of the world). In a curious twist of fate, I suspect this article will be probably fed to train the next generation of AI models though.
flangola7 4y ago
Tech companies really should be required to submit their mass sociology experiments to an IRB.
rnosov 4y ago
What strikes me the most about ChatGPT is how convincing it is at justifying patent nonsense. For example, I've noticed it has some strange obsession with sunscreen. Even for absurd questions such as "Should I wear sunscreen on the North Pole in December?" it still makes up a plausible list of reasons in favour of wearing sunscreen.
- flir 4y ago
  "Sunscreen is one of the most important items to pack for polar travel, as it is our goal that you will spend most of your time outside. Sunlight reflecting off the snow can quickly cause a burn." - https://oceanwide-expeditions.com/blog/what-to-pack-for-your-expedition-cruise-to-the-arctic-or-antarctica https://oceanwide-expeditions.com/blog/what-to-pack-for-your... I didn't know either, I just suspected it might be true. Trust The Computer. The Computer is your friend.
  - SillyUsername 4y ago
    Well if that hole in the ozone layer passes overhead it might have a point :D
    - mathteddybear 4y ago
      It's a long night.
    - noman-land 4y ago
      It's basically closed now!
  - rnosov 4y ago
    Well I've addressed it by specifying December timeframe (height of the polar night on the North Pole without any sun to speak of). Sometimes ChatGPT even addresses the issue of the lack of sunlight in it's reasoning and still recommends it.
verteu 4y ago
The risks of "AI harm" seem overblown to me. The negative examples in the news (eg Sydney) look more like PR problems than societal risks. While improved LLMs will aid bad actors in spam/astroturfing, there's almost nothing we can do about it -- gatekeeping the models helps a little, but they seem to be reverse-engineered in <1 year regardless. I can't help but wonder who's pushing this "AI safety" narrative, and why.
- jerpint 4y ago
  It’s PR on top of PR. OpenAI is “dedicated to making ai open TM” but also to making AI safe, so for “our safety”, opts not to release models. Not for business reasons /s
- ShredKazoo 4y ago
  The AI safety narrative is being pushed by people who think that if we can't control today's AI, we won't be able to control tomorrow's AI either. Yep, current AI harms seem fairly limited. And when gorillas first saw humans on the savanna, the human harms to their habitat were also quite limited. We may only have a single chance to get smarter-than-human AI right.
  - RandomLensman 4y ago
    The AI safety discussions mask that we are nowhere near high powered AGI. Maybe we'll never get there, but the discussions make AI look more powerful than it is, i.e., it's a marketing angle.
    - HDThoreaun 4y ago
      If there's a 1% chance of a fast takeoff within the next decade is that not something we should take seriously? I really don't think AGI within the next decade is completely off the table.
      - RandomLensman 4y ago
        What if the chance is only 0.001%? How would we know?
ChatGTP 4y ago
Microsoft has invested billions of dollars in OpenAI, the company whose technology is behind that new Bing and which spurred the current AI hubbub with its own wildly popular ChatGPT bot and Dall-E 2 image generator. This is what concerns me, if this thing doesn't turn out to be great for society, it will still be pushed down peoples throats because a ROI needs to be made, a lot of money is at stake and so here we are. Hopefully it goes ok.
- ChatGTP 4y ago
  If you down vote, why? Do we think Microsoft is a charity?
  - Robotbeat 4y ago
    Because I guess uninsightful “late capitalism doomerism” copypasta isn’t encouraged on HN? It helps if comments don’t read like they’re written so lazily in their criticism that ChatGPT could’ve written them.
    - MonkeyClub 4y ago
      GP has a valid point on the ROI comment, though - the platform will be promoted regardless of second thoughts on externalities such as accuracy and social effects. Large buckets of money have been already thrown its way, and there must be a ROI registered, even if it's pushed fast and hard and through lots and lots of PR.
  - politician 4y ago
    If you’re going to claim this username, the very least you could do is to never comment independently, but only respond with the key points of the article as summarized by ChatGPT.
gibsonf1 4y ago
The key issue I think is the lie that this system is intelligent in any way, it simply isn't. And if people approach it that way, that it's just statistically fabricating word text patterns from massive input word text, it will remove the dangers mentioned and enable people to know that its not expressing thoughts as people do with words, but just outputting words that may or may not have any correspondence with the truth. That OpenAI and others claim it has intelligence, when it clearly does not, will make for interesting legal liabilities going forward if people experience any harm with the system and decide to take legal action. (Also true for autonomous driving which uses the same ml/dl tech) Ml/dl can be very helpful and factual as artificial perception when the input is directly from space-time and give factual measurements as input to conceptual awareness, but perception alone does not intelligence make.
- politician 4y ago
  If you downvoted this, please do us all a favor and open ChatGPT and ask it to describe how it works.
  - SpicyLemonZest 4y ago
    I don't see why that's persuasive. I can't explain how my brain works either!
braindead_in 4y ago
I was expecting a call for regulation towards the end. OpenAI has to be very careful about the narrative. They have moved first and stated that in the hands of an autocratic regime, it can be a dangerous tool. https://openai.com/blog/planning-for-agi-and-beyond/ https://openai.com/blog/planning-for-agi-and-beyond/
- wankle 4y ago
  It's marketing, "look at this powerful thing we created, let's make sure it doesn't get into the wrong hands!".
752963e64 4y ago
[dead]
ravenstine 4y ago
I have my concerns about how AI will affect humanity, but there's something else on the other end of that spectrum that's been on my mind. Effectively, we've implemented the ship's computer from Star Trek TNG. While there's enough enthusiasm that average people are playing with ChatGPT, it seems that the "glass half empty" attitude is far outweighing the perspective that we've achieved something that was once complete fantasy in our lifetimes. Nobody I know, including those with greater ML/AI knowledge than mine, is in as much awe as I am. Current generation LLMs are something we're already taking for granted as a cool toy, or we're concluding it's crap because it doesn't have a God-like grasp on facts, or we're waiting for it to become Skynet. Given the overall response we're having to this technology, I can't help but conclude that society is overdue for being put in its place, and perhaps it even needs to be knocked down a peg. The real problem with AI may not be so much the technology itself but that we're not deserving or truly ready for it.

58 points by gibsonf1 4y ago

In modern society, we prioritize the ease of bringing new products to market over regulation and testing. The only industry we prospectively regulate for safety is the pharmaceutical industry. Otherwise, regulation is retrospective and slow. Look at the way we regulate harmful chemicals. After studies find that chemicals found in consumer products are harmful, manufacturers spend several years redesigning their products to avoid them. After manufacturers have voluntarily redesigned their products, the chemicals are banned. The manufacturers often replace the harmful chemicals with structurally similar chemicals that have not yet been shown to be harmful. When those similar chemicals are shown to be harmful, the cycle repeats. This is the history of phthalates, which are used to soften PVC plastic. The CPSC first considered banning one phthalate (DEHP) in children's toys the 1980s. Before that happened, all large manufacturers replaced it by another phthalate (DINP), which also turned out to be harmful. Both DEHP and DINP were finally banned by congressional action in 2008. Technology is not a chemical, but anything that people will be spending significant time interacting with is likely to have some effect on their wellbeing, potentially small but potentially large, potentially positive but potentially negative. The type of harms these chatbots might cause are difficult to predict in advance. It could take a couple years to determine whether the current generation of chatbots are actually a net positive or negative for society. In that time, they may become too entrenched for us to do anything if they do turn out to be harmful. When Facebook first came out, I doubt many people foresaw the negative impact that it could have on teenagers. Today, many studies show that social media use has a negative impact on kids' wellbeing, but there is no going back to a pre-social media world. Prospectively testing and regulating tech in the same way we regulate pharma seems insane. OTOH, we do want to make sure that world-changing tech actually changes the world for the better, and the only obvious way to do this is through some kind of regulation. Although regulation will undoubtedly slow growth, many of us would be happy to sacrifice some growth for improved wellbeing. At this point, everyone has seen the productivity-pay gap plot showing that most of the improvement in US productivity since 1979 has not translated into increases in real wages. Our current "growth at almost any cost" strategy benefits corporations much more than it benefits the average person.

catchnear4321 4y ago

Always have been. (This case is just more conspicuous.)

skilled 4y ago

https://archive.is/W3qCe https://archive.is/W3qCe

jeleh 4y ago
thanks! :+1!

elicash 4y ago

People aren't worried about hurting themselves with AI, they're expressing that other people are too dumb or irresponsible to use it properly. I'm less sympathetic to this concern. Not totally dismissive. I think some of the restrictions are fair for a company running a business. If you want to sell to other companies, make sure your bots don't use racial slurs, for example. But I don't think there's an ethical issue.

osigurdson 4y ago
Yes, the persistent MAD argument (masses are dumb). It’s ok for the smart me but not for dumb others. Sorry, normal distribution does not agree.
- omnicognate 4y ago
  There's no correlation between intelligence and likelihood of being hoodwinked by this stuff afaict. The human biases involved are universal and plenty of very smart people are publicly attributing to it capabilities it doesn't possess. I've used it enough to know it has no utility for me. I don't expect my world to be improved by others using it, and I think there's a strong chance it will be made materially worse. That doesn't mean I think it should be banned, that the people that invented it have done something immoral or that I'm smarter than anyone else.
SpicyLemonZest 4y ago
I'm absolutely worried about hurting myself with AI. I don't think you or I or anyone else is smart enough to avoid falling for AI-generated misinformation at scale.

epups 4y ago

> Eliminating made-up information and bias from chat-based search engines is impossible given the current state of the technology, says Mark Riedl, a professor at Georgia Institute of Technology who studies artificial intelligence. He believes the release of these technologies to the public by Microsoft and OpenAI is premature. “We are putting out products that are still being actively researched at this moment,” he adds. As far as I can tell, this is the gist of the article, which I find boring. When Google started, its main product was still being actively researched - heck, it was the result of an algorithm from two grad students. You definitely had and still have made-up and biased results there too. Yet it was an incredibly useful technology.

kevingadd 4y ago
Google listing search results that are unverified is a little different from an AI confidently answering a question wrong in English prose, isn't it? Only one of them is asserting truth.
- Kamq 4y ago
  > Only one of them is asserting truth. Have any of these companies actually asserted any truth around these models? I mean, the model itself asserts a bunch of truth, but I have a lot of books that confidently assert truths that are completely wrong (fiction), and it hasn't caused many problems. This seems more like it depends very much on how the product is framed. If these companies are claiming that the models are completely accurate, they should definitely be hit for some kind of fraud, but I haven't actually seen that. The closest I've seen is companies claiming that they could be useful (and based on comments here, I think that's quite justified).
- Robotbeat 4y ago
  Not really. In fact with Google it could be worse as it can unknowingly lead you to a fake site (spammer site meant to look like an official government website, for instance), whereas ChatGPT gives you explicit acknowledgement when you log in that a lot of the stuff it says is fake, plus it is clear you’re chatting with an AI.

mistrial9 4y ago

"we" ?! appeal to populism, from the trade journal of top hats and Pinkertons. knee-jerk disdain aside.. Even the lofty towers of Finance and their close companions Legal, are feeling the hot breath of AI creatures it seems. They are right to be alarmed, for it is within their own ranks that the most unexpected and treacherous uses of this tech will occur. Sure, some salesman in San Francisco claims that he can sell ads to a Billion South Asians, but "we" all know that it is in the inches of legal documents, and public fiduciary statements, that things will get really messy, really quickly. Bye bye venture capitalist club -- you were raging tigers and you will tear yourselves into bloody bits in front of everyone.

bigger_inside 4y ago
I enjoyed this comment. A judge in Colombia said he used chatGPT: https://forogpp.com/2023/02/03/a-judge-in-cartagena-colombia-claims-to-have-use-chatgpt-as-support-tool-to-resolve-a-guardianship-for-health-care-neglect/ https://forogpp.com/2023/02/03/a-judge-in-cartagena-colombia... own ranks? treacherous use? check? When automation came for factory workers, the exploiters cheered. When it came for the service jobs, the exploiters cheered. When it comes for the knowledge workers.. well, the exploiters will still cheer, just that the bullshit job class (https://www.atlasofplaces.com/essays/on-the-phenomenon-of-bullshit-jobs/ https://www.atlasofplaces.com/essays/on-the-phenomenon-of-bu...) will suddenly realize that they were never a part of the exploiter class to being with. They were just servants convinced that they were, like Heinrich Popitz' deck chair guardians on the cruise ship...
RandomLensman 4y ago
It will be interesting to see if AI will be accepted to provide the more "theological" services of high priced consultants and advisers.

ThrowawayTestr 4y ago

"for horseless-carriages, we are all once again tech companies' guinea pigs"

kevingadd 4y ago
Considering how many people get killed by cars every day and how they reshaped American society I'm not sure how to interpret this analogy.

melling 4y ago

Sounds good. Let’s get the technology over the finish line. The future is behind schedule.

MonkeyClub 4y ago
> The future is behind schedule. This reminds me of the old 2600 crowd poster of "1984 - we're behind schedule". I don't think this quick find[1] is the original poster, as I seem to remember it referencing the Secret Service rather than the NSA, but it sure does capture the whole idea well enough. [1] https://steemitimages.com/DQmTEZ3U2U5DrgXDax5wmvaXvWa7rKyaS8kpsGLwRmGppX7/image.png https://steemitimages.com/DQmTEZ3U2U5DrgXDax5wmvaXvWa7rKyaS8...
- melling 4y ago
  I don’t remember that one. People love to reach for the dystopian future point of view. I do remember 20 years ago the ad nauseam complaints about tracking cell phones. Then 7-8 years ago we had the complaints about Amazon Alexa. I’m simply talking about millions of people essentially crowdsourcing a solution. It’s more valuable than wasting all that time complaining about AI

karaterobot 4y ago

Seriously, someone should stop OpenAI from hijacking people's browsers to make them go to ChatGPT. And I also agree that it's evil of Microsoft to leverage its wildly popular Bing and Edge platforms — which we were already all totally using — and insert this malicious AI into it. And all without any repeated, near-constant warning that this is a beta project that should not be trusted. This was forced on us, and not something that went virally popular and got people excited to try it.

xg15 4y ago
I mean for a short while I was actually dreading that one day my Word would auto update and I'd be greeted by Clippy again - Microsoft's initial press statements while the ChatGPT hype was at its peak did sound a bit as if they were scrambling to stuff ChatGPT in as many products as possible before any competitor could make a move. But I think by now, Bing aka Sydney has made a very convincing case to Microsoft that this would be a very bad idea.

flandish 4y ago

Well yeah. If it’s free, you’re the product. Socialize the research and the risk, privatize the profit and future.

MonkeyClub 4y ago
> If it’s free, you’re the product. Be careful when using this phrase around here, it's a sure-fire way to get grayed out to obscurity. There seems to be a subset of HNers who take offense every time they encounter it, because it's a "platitude". That doesn't make it any less true, though :)
- flandish 4y ago
  I don’t disagree - the usual cohort here is people looking for that extra “capitalist help” with the whole “bootstraps” marketing angle popular these days. And you’re right: doesn’t make it less true. I suppose in the gpt space it may be “if it’s free, you’re the QC phase.”
ThrowawayTestr 4y ago
How is Microsoft giving openai 10 billion dollars "socializing the research"?
- flandish 4y ago
  That’s not what I spoke of. I stated “if it’s free.” Don’t mix up direction and order of operations here. MS “giving” is an investment. GPT being free to use (us) is also a form of investment. Look at healthcare. Govs (taxpayers) funded research into vaccines that then … get returned to profit to corporations. Not to lowering of taxes.

ergonaught 4y ago

Companies wouldn't ship prematurely and broken if consumers/customers cared enough to stop using them. Scale, network effects, etc, have all come together to ensure that this essentially never occurs. Worse, really, people will passionately and irrationally defend garbage. The "first mover advantage" and such is a reality created by consumer/customer behavior, not by "tech" companies using the world as a pool of beta testers.

roflyear 4y ago
People who are fanboys of these massive companies are so weird to me.
- ergonaught 4y ago
  Huh?
  - roflyear 4y ago
    Being a fanboy of a company like Google is just weird to me.
ergonaught 4y ago
The downvotes this received amplify my fear for the future of this species.

jillesvangurp 4y ago

What a load of alarmist nonsense. Who is the royal "we" in this article's title? Clueless Wall Street Journal reading "victims"? Or just curious people that signed up for this. I believe it's the latter. If you don't want it, don't sign up for it, or opt in. Refrain from using it. Very simple.

pixl97 4y ago
Right, just like 'we' can avoid pollution and traffic from automobiles....
varelse 4y ago
[dead]
manimino 4y ago
Yep. Standard clickbait formula, stir up emotions, add no new information. So easy an AI could do it.
politician 4y ago
“We” refers to the WSJ hive mind of employees. In the dark ages before ChatGPT, the only access individuals had to large language models was through the editing process that newsrooms use to harness the power of dozens of human brains. These archaic processes had severe bandwidth limitations that prevented the level of individualized interaction that we all benefit from today.
rnosov 4y ago
I think it's "we" as in "real humans" vs them "AI chatbots". It would be easy to avoid them at the moment but might be a lot harder in the future (in a way it becomes difficult to use physical cash in many parts of the world). In a curious twist of fate, I suspect this article will be probably fed to train the next generation of AI models though.

flangola7 4y ago

Tech companies really should be required to submit their mass sociology experiments to an IRB.

rnosov 4y ago

What strikes me the most about ChatGPT is how convincing it is at justifying patent nonsense. For example, I've noticed it has some strange obsession with sunscreen. Even for absurd questions such as "Should I wear sunscreen on the North Pole in December?" it still makes up a plausible list of reasons in favour of wearing sunscreen.

flir 4y ago
"Sunscreen is one of the most important items to pack for polar travel, as it is our goal that you will spend most of your time outside. Sunlight reflecting off the snow can quickly cause a burn." - https://oceanwide-expeditions.com/blog/what-to-pack-for-your-expedition-cruise-to-the-arctic-or-antarctica https://oceanwide-expeditions.com/blog/what-to-pack-for-your... I didn't know either, I just suspected it might be true. Trust The Computer. The Computer is your friend.
- SillyUsername 4y ago
  Well if that hole in the ozone layer passes overhead it might have a point :D
  - mathteddybear 4y ago
    It's a long night.
  - noman-land 4y ago
    It's basically closed now!
- rnosov 4y ago
  Well I've addressed it by specifying December timeframe (height of the polar night on the North Pole without any sun to speak of). Sometimes ChatGPT even addresses the issue of the lack of sunlight in it's reasoning and still recommends it.

verteu 4y ago

The risks of "AI harm" seem overblown to me. The negative examples in the news (eg Sydney) look more like PR problems than societal risks. While improved LLMs will aid bad actors in spam/astroturfing, there's almost nothing we can do about it -- gatekeeping the models helps a little, but they seem to be reverse-engineered in <1 year regardless. I can't help but wonder who's pushing this "AI safety" narrative, and why.

jerpint 4y ago
It’s PR on top of PR. OpenAI is “dedicated to making ai open TM” but also to making AI safe, so for “our safety”, opts not to release models. Not for business reasons /s
ShredKazoo 4y ago
The AI safety narrative is being pushed by people who think that if we can't control today's AI, we won't be able to control tomorrow's AI either. Yep, current AI harms seem fairly limited. And when gorillas first saw humans on the savanna, the human harms to their habitat were also quite limited. We may only have a single chance to get smarter-than-human AI right.
- RandomLensman 4y ago
  The AI safety discussions mask that we are nowhere near high powered AGI. Maybe we'll never get there, but the discussions make AI look more powerful than it is, i.e., it's a marketing angle.
  - HDThoreaun 4y ago
    If there's a 1% chance of a fast takeoff within the next decade is that not something we should take seriously? I really don't think AGI within the next decade is completely off the table.
    - RandomLensman 4y ago
      What if the chance is only 0.001%? How would we know?

ChatGTP 4y ago

Microsoft has invested billions of dollars in OpenAI, the company whose technology is behind that new Bing and which spurred the current AI hubbub with its own wildly popular ChatGPT bot and Dall-E 2 image generator. This is what concerns me, if this thing doesn't turn out to be great for society, it will still be pushed down peoples throats because a ROI needs to be made, a lot of money is at stake and so here we are. Hopefully it goes ok.

ChatGTP 4y ago
If you down vote, why? Do we think Microsoft is a charity?
- Robotbeat 4y ago
  Because I guess uninsightful “late capitalism doomerism” copypasta isn’t encouraged on HN? It helps if comments don’t read like they’re written so lazily in their criticism that ChatGPT could’ve written them.
  - MonkeyClub 4y ago
    GP has a valid point on the ROI comment, though - the platform will be promoted regardless of second thoughts on externalities such as accuracy and social effects. Large buckets of money have been already thrown its way, and there must be a ROI registered, even if it's pushed fast and hard and through lots and lots of PR.
- politician 4y ago
  If you’re going to claim this username, the very least you could do is to never comment independently, but only respond with the key points of the article as summarized by ChatGPT.

gibsonf1 4y ago

The key issue I think is the lie that this system is intelligent in any way, it simply isn't. And if people approach it that way, that it's just statistically fabricating word text patterns from massive input word text, it will remove the dangers mentioned and enable people to know that its not expressing thoughts as people do with words, but just outputting words that may or may not have any correspondence with the truth. That OpenAI and others claim it has intelligence, when it clearly does not, will make for interesting legal liabilities going forward if people experience any harm with the system and decide to take legal action. (Also true for autonomous driving which uses the same ml/dl tech) Ml/dl can be very helpful and factual as artificial perception when the input is directly from space-time and give factual measurements as input to conceptual awareness, but perception alone does not intelligence make.

politician 4y ago
If you downvoted this, please do us all a favor and open ChatGPT and ask it to describe how it works.
- SpicyLemonZest 4y ago
  I don't see why that's persuasive. I can't explain how my brain works either!

braindead_in 4y ago

I was expecting a call for regulation towards the end. OpenAI has to be very careful about the narrative. They have moved first and stated that in the hands of an autocratic regime, it can be a dangerous tool. https://openai.com/blog/planning-for-agi-and-beyond/ https://openai.com/blog/planning-for-agi-and-beyond/

wankle 4y ago
It's marketing, "look at this powerful thing we created, let's make sure it doesn't get into the wrong hands!".

752963e64 4y ago

[dead]

ravenstine 4y ago

I have my concerns about how AI will affect humanity, but there's something else on the other end of that spectrum that's been on my mind. Effectively, we've implemented the ship's computer from Star Trek TNG. While there's enough enthusiasm that average people are playing with ChatGPT, it seems that the "glass half empty" attitude is far outweighing the perspective that we've achieved something that was once complete fantasy in our lifetimes. Nobody I know, including those with greater ML/AI knowledge than mine, is in as much awe as I am. Current generation LLMs are something we're already taking for granted as a cool toy, or we're concluding it's crap because it doesn't have a God-like grasp on facts, or we're waiting for it to become Skynet. Given the overall response we're having to this technology, I can't help but conclude that society is overdue for being put in its place, and perhaps it even needs to be knocked down a peg. The real problem with AI may not be so much the technology itself but that we're not deserving or truly ready for it.