3 ms·
Googlers say Bard AI is “worse than useless,” ethics concerns were ignored
- cs702 4y agoApparently, Google employees were asked to test Bard pre-release, but their feedback was mostly ignored by managers intent on launching Bard as quickly as possible. Bloomberg obtained copies of pre-launch discussions in which internal testers describe Bard as "cringe-worthy" and "a pathological liar." One employee wrote a post titled, "Bard is worse than useless: please do not launch." Google launched it anyway a few weeks later.
- BoorishBears 4y agoYeah but I've said before, if Google had GPT 4, we wouldn't have public access. The reality is Google has filled itself to the brim with experts on their domains, rather than experts on their domains as they fit into a larger picture. It's cool to be a 10x engineer, but if you're turning basic tasks in 100x efforts in the pursuit of engineering rigor, you're going to get your lunch ate by 1x engineers using unsexy unscalable tech. The source article is a much better read: https://www.bloomberg.com/news/features/2023-04-19/google-bard-ai-chatbot-raises-ethical-concerns-from-employees https://www.bloomberg.com/news/features/2023-04-19/google-ba... Based on its contents I was not convinced that Bard is actually so terrible vs Google's internal testers simply upholding a bar that's not realistic for the current crop of LLMs, especially when you read things like: > In some, like child safety, engineers still need to clear the 100% threshold. How do you child proof an LLM? Why wouldn't you instead just release it and say supervise your child's use the same way you would for 99% of the internet?
- wpietri 4y agoIt seems odd to me that you're complaining that Google experts are not seeing the bigger picture, when from what I see they are the ones taking ethical concerns seriously. If solving health and safety risks is "not realistic for the current crop of LLMs", maybe they in fact should not be in the wild? LLM's already have a body count [1], so child safety doesn't sound like an unreasonable thing to ask about. Dumping the responsibility on parents does not actually mitigate the ethical concerns; its just a way of ignoring the "larger picture". [1] E.g., https://www.brusselstimes.com/belgium/430098/belgian-man-commits-suicide-following-exchanges-with-chatgpt https://www.brusselstimes.com/belgium/430098/belgian-man-com...
- yazzku 4y agoHow are they taking ethical concerns seriously? They launched the thing despite the internal employees' feedback that the thing lies and says things that would lead to injury or death.
- wpietri 4y agoSorry, I am speaking of the employees taking concerns seriously, not Google itself. I'll edit to clarify.
- kalium-xyz 4y agoWhat is googles but a sum of its employees?
- wpietri 4y agoDo you think Google is some sort of... democracy? Like they all get together and build consensus for a particular course of action?
- BoorishBears 4y agoYou're showing off a perfect example of understanding your domain vs understanding the bigger picture. In your mind not having "100% child safety" is apparently equivalent to "not solving health and safety risks". Unfortunately that's not a take that's compatible with the reality on the ground. The internet is not 100% child safe and if we had locked it up until it was, there'd be no internet. What people fail to understand is that sometimes settling for something strictly worse in domain terms results in a much better overall outcome. — For example, who's having more impact on the future of safety and alignment in LLMs: - Someone working on ethics at OpenAI; who settled for Google's "80%" on all topics including child safety and is therefore empowered to actually achieve that (with a massive head start on learning how alignment is being broken in the real world) - Or someone working on ethics at Google; who was stuck on 100% until their project stalled and their entire opinion got discarded and they get laid off and the thing goes out with an "experiment" label and significantly less testing? You can't steer the ship if it sinks. Some companies are currently at a place where everyone has their hand on the rudder pulling in their own direction as the ship runs into an iceberg because everyone is certain that their direction is correct, and the other direction is certain doom for humanity. At the end of the day you need to learn to discard that sort of extremism, the world is not that black and white.
- Trouble_007 4y ago>The source article is a much better read: https://archive.is/uhhl4 https://archive.is/uhhl4
- Trouble_007 4y agoI well remember the launch; Google shares drop $100B because of Bard : https://www.npr.org/2023/02/09/1155650909/google-chatbot--error-bard-shares https://www.npr.org/2023/02/09/1155650909/google-chatbot--er... Posted by nigamanth 69 days ago - 8 comments : https://news.ycombinator.com/item?id=34749560 https://news.ycombinator.com/item?id=34749560
- 5350-uiop-1130 4y ago> google layoffs thousands: stock goes up > google releases bard: stock goes down some balance in the universe. you have this futuristic AI tech and you name it "Bard".
- Trouble_007 4y agoLet's be Honest, Ethics only matter to Corporations when finances are negatively affected.
- bheadmaster 4y agoI'm wary of anyone claiming to be the arbiter of ethics in general. It always sounds like just authoritarianism in disguise.
- nullc 4y agoI think corporations caring about ethics in so far as it impacts the bottom line is a much safer outcome than them caring about ethics as a terminal objective... All serious atrocities that have been done in the history of man have been done by people who believed what they were doing was good. Trying too hard to be good is exactly how you do evil, and not just conventional banal evil, but the truly horrifying stuff like outright genocide. Ethics as triggered by bottom line concerns becomes part of a feedback cycle involving the greater market. It provides a way to stem some of the worst ethical transgressions without having much potential for running off on a tangent and doing evil by trying too hard to do "good", as those efforts will also hurt the bottom line. Greed follows incentives, so collectively we can predict and control much of the harm it can create. When some person or organization is motivated by belief it's going to be much less responsive and we better hope that their beliefs are exactly right or that the entity doesn't have much power. It's easy and common for bloated quasi-monopolists to engage in an awful lot of activity which has little to do with improving the bottom line, so the the mere existence of ambient capitalism isn't sufficient to ward off misguided and out of control do-gooding. It can be particularly bad when they do since they begin the activities with a lot of power (which they usually gained through productive activities in the past before they were diverted). Overwrought claims of do-gooding are also easily abused to undermine our civil process and steam roll protections which were established because our forebearers recognized the risk of popular whim and expedience. A few "think of the childrens" and you've deputized the state to carry out your campaign of oppression. We're a bit less willing to roll over just because someone wants to make more money. I don't mean to argue that what you get from profit driven ethics is great or that we can't supplement it with other backstops (including regulations, whistleblower protections, a non-precarious employment situation so people can follow their consciences, etc) but you really can do much worse than "is ethical in so far as its profitable, is unethical in so as it's profitable and you can get away with it", and I think that perspective is important. From this position it's easier to see how google's transition from "Don't be evil" to "Do the right thing" can be seen in an absolutely chilling light.
- mrtweetyhack 4y ago[dead]
- local_crmdgeon 4y agoWhat does ethics mean here? That the robot hallucinates? So do all the others.
- yazzku 4y agoIt means not putting profits before the concerns of a technology that has already proven to be garbage just because you are nervous about other companies winning the AI hype race.
- remarkEon 4y agoOne thing I don't understand about the AI "ethics" debate is that it's a debate about the behavior of a singular system. One single AI. In this case, Google's. Do people honestly think there is some happy medium that everyone will agree with for standard behavior of a machine that is attempting to emulate the human mind?[1] Of course there isn't. Humans exist on a vast spectrum. It seems we're somehow arguing about one machine that attempts to emulate that spectrum. [1] https://en.wikipedia.org/wiki/Dune_(franchise)#The_Butlerian_Jihad https://en.wikipedia.org/wiki/Dune_(franchise)#The_Butlerian...
- alkibiades 4y agohaving worked at a lot of these companies including google itself. most of the employees are complete whiners and complainers that will block everything. think they made the right choice in ignoring them if they want velocity
- davidgerard 4y agoSounds like Google+ twelve years ago - employees detailed precisely what would happen, and it happened and it was a disaster. In fact, I think Google+ is what finally did in Google's golden reputation with techies. The answer is: who is the PM and what are their incentives? That's how Google+ became an all-consuming trash fire, and it'll be what's happening here.
- pcdoodle 4y agoGood job google, now do search.