19 ms·
Google warns its own employees: Do not use code generated by Bard
- metadat 3y agoDiscussed 5 days ago: Google warns staff about chatbots https://news.ycombinator.com/item?id=36341188 https://news.ycombinator.com/item?id=36341188 (107 comments)
- vsskanth 3y agoYeah Google Bard seems to make up stuff way more than chatgpt and gives just wrong code. I asked for numpy code to fit a polyline rejecting outliers and it just made up an argument "robust" for polyfit. Chatgpt on the other hand generated a function that calculated standard deviation and removed points outside two sigma.
- sedatk 3y agoGoogle Bard shamelessly tells my World War II stories[1]. Bing Chat refuses to answer such a question or says “no information” depending on its creativity level. [1] https://twitter.com/esesci/status/1669066574366646274 https://twitter.com/esesci/status/1669066574366646274
- eyegor 3y agoAlthough that's garbage for factual tasks, the creative writing behavior is a perfect fit for fleshing out dnd characters for example. On the other hand, Google is a search/ad company... I'd think they'd be the most interested in integrating search/facts into an llm. Hallucinating details about your customers is a good way to cause problems (some lawsuits already filed).
- TeMPOraL 3y ago> On the other hand, Google is a search/ad company... I'd think they'd be the most interested in integrating search/facts into an llm. At its core, an advertisement is made of two components: the subject - a store, a brand, a product, etc. - with which the victim is supposed to develop positive associations, ideally strong enough to motivate a purchase and/or advertising the subject to their acquaintances, and the message, which is meant to create those associations. Only the first part, the subject, has to be factual. The message does not, and in fact it usually isn't - manipulative bullshit performs much, much better, and generally the optimum for advertising seems to be asymptotically close to the line past which it would be legally fraud. The only factual part, the subject, needs accurate handling, and is best suited for classical database systems - which is exactly how Google, and everyone else, is handling it. The message part - that's a good match to LLMs, which excel at producing convincingly sounding bullshit. For advertising, it seems what you need is to crank up the hallucinations a bit, but have some plausible deniability built into the whole system, so that when the LLM hallucinates in too obvious a way, no one can actually be held responsible.
- sofixa 3y agoWow that's a lot of creativity - not only did it make up a bunch of information, that information doesn't even make sense within the well known and understood historical context of WW2 (Turkey was neutral so there is no scenario under which a Turkish soldier is "sent to the Eastern Front to fight the Soviet Union").
- nonrepeating 3y agoSorry, I’m sure this was annoying at the time, but making up that argument is hilarious in retrospect, no?
- deleted 3y ago[deleted]
- sakesun 3y agoํYes. Google Bard often make up imaginary syntax and commands.
- ec109685 3y agoHere’s an example where Bard is making up studies to support RFK’s thesis that drinking water causes transgenderism: https://twitter.com/EbenThurston/status/1670619027608092674?s=20 https://twitter.com/EbenThurston/status/1670619027608092674?... It’s flat out lying, yet folks are using its output in arguments.
- logicchains 3y agoHere's a real study: https://pubmed.ncbi.nlm.nih.gov/29314190/ https://pubmed.ncbi.nlm.nih.gov/29314190/ . It found when frogs were exposed to atrazine (a herbicide) in wastewater runoff, "female minnows were defeminized, whereas male frogs were feminized". Similarly https://www.pnas.org/doi/10.1073/pnas.0909519107 https://www.pnas.org/doi/10.1073/pnas.0909519107 found that "Atrazine-exposed males were both demasculinized (chemically castrated) and completely feminized as adults. Ten percent of the exposed genetic males developed into functional females that copulated with unexposed males and produced viable eggs." So Atrazine can cause frogs to change their gender, and contaminates drinking waters in part of the US (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6164008/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6164008/), so it's not beyond the realm of possibility that it also influences gender expression in humans to some degree.
- mfjordvald 3y agoEgg temperature plays a definitive role in the sex of turtles, but no one would claim it in the realm of possibility for that to affect humans. It's always good to be aware of how things affect human hormones and absolutely worth study and regulation, but it's a huge jump from frogs are affected to humans are affected. I know right wing people are world class long jumpers so this kind of "it could be!" really isn't helping towards a reasonable debate.
- rsynnott 3y agoHadn't realised he was on the General Ripper bandwagon.
- Lerc 3y agoIs this because of the accuracy of the results, or is it the rights to the content that is the problem? Barring any AI court case setting a precedent, We're still at 'AI generated works are public domain' aren't we? There's probably going to be some big money arguing for the right to own content generated by their AI. I can't really see that being in the public interest though.
- caturopath 3y ago> We're still at I didn't hear we were ever there?
- wernercd 3y agoWere we ever NOT there? https://builtin.com/artificial-intelligence/ai-copyright https://builtin.com/artificial-intelligence/ai-copyright "Can AI Art Be Copyrighted? It has long been the posture of the U.S. Copyright Office that there is no copyright protection for works created by non-humans, including machines. Therefore, the product of a generative AI model cannot be copyrighted."
- jeffparsons 3y ago> Therefore, the product of a generative AI model cannot be copyrighted Is that last bit from the Copyright Office, or is it the author's interpretation? Because I could just as easily imagine the battle being over who or what was the actual creator of the content (i.e. is it a derivative work), rather than whether the thing the machine created is eligible for copyright. To remove the AI from the equation for a second, imagine that I took four images of living artists' work, placed them in a 2x2 grid, and called that a new artwork. There are two seperate questions to consider: (1) have I infringed upon the original authors' copyrights, and (2) is the new thing I have created eligible for copyright. The stance that there is "no copyright protection for works created by non-humans" only addresses the second question, not the first question of how it interacts with existing copyrights.
- 3y ago
- travisr 3y agoThis isn’t surprising. It’s like saying “don’t post sensitive/proprietary info on stackoverflow and don’t blindly paste code from there into your professional work.”
- ineedasername 3y agoExcept they have an offering in the market for other people to do just that. Put stackoverflow aside, that’s not Google. Gooogle telling staff to not use Bard would be like telling them a decade ago “don’t use android”
- pgeorgi 3y ago> Except they have an offering in the market for other people to do just that. bard.google.com states right on the front page: "Bard is an experiment and may give inaccurate or inappropriate responses." Also, the warning is about _all_ LLMs.
- ineedasername 3y agoAnd google is nonetheless happy to have countless other coders use their experiment, just not their own. Leave other LLMs to the side on this issue. There are a variety of different issue that arise when Google employees might use a non-Google LLM, so that prohibition is in a category with different reasons.
- pgeorgi 3y ago> And google is nonetheless happy to have countless other coders use their experiment, just not their own. What makes you think so? Those LLMs aren't primarily coding tools. > Leave other LLMs to the side on this issue https://www.reuters.com/technology/google-one-ais-biggest-backers-warns-own-staff-about-chatbots-2023-06-15/ https://www.reuters.com/technology/google-one-ais-biggest-ba... indicates that the ban is about "all LLMs, period". It's ElReg who, true to their style, decided to focus the discussion on Google employees using (or not using) Google's LLM. Even they, however, acknowledge that Google "also advised users not to include sensitive information in their conversations with Bard in an updated privacy notice." As such, Google seems to apply the same standard to other users (including "countless /other/ coders") that it applies to its employees, no?
- buro9 3y agoThis is Google, who have a monorepo, who are afraid of the legal risks to the monorepo. The copyright of the output of these tools is not yet determined, it's a risk. The advice not to use the tools in a risky way not only directly mitigates the risk but like an "employees must wash hands" sign in a restaurant restroom, it can be seen as a reasonable step that transfers some of the liability to the staff member. It's not a verdict on the output of the tools, it's a reflection of risk aversion in a monorepo company that is very protective of what is in the monorepo.
- samwillis 3y agoI doubt the fact they use a monorepo has any impact on this thinking. A versioned sourced repository is no different from a file server. If some "ai copyright infringed" code made it into the monorepo it doesn't compromise the whole thing. There are still clear distinct projects and products. But exactly, this is a hygiene thing. Staff will still be using these tools anyway.
- praptak 3y agoI agree that monorepo does not make a fundamental difference. Still it makes it easier for some undesirable things to happen. The tainted code can become a critical dependency. It can get copy-pasted elsewhere. An engineer could look at the code before writing their own (obviously not illegal per se but makes it harder to repeal bullshit claims later). An engineer can just write similar code and then have no way to prove they didn't look (ditto).
- mcny 3y ago> It can get copy-pasted elsewhere. I have no experience working with a monorepo but I've read Google has "an army" of people maintaining the monorepo. I would have imagined with enough support like this, you wouldn't need to copy paste code everywhere in a monorepo? I'd appreciate any insight anyone can share on monorepo. I am fascinated by the idea but I've never had a chance to work with it and people who I've met who have either don't want to or can't talk about their experience with it.
- lyu07282 3y agoBut has anyone actually tried Bard for coding in practice? It's so awful, practically unusable. GPT4 feels several generations ahead of Bard.
- londons_explore 3y agoAgreed. I frequently use GPT-4's code. It is especially useful coding in a domain I'm not familiar with. I recently asked it to write a blender plugin to export certain polygons to a spreadsheet (with coordinates projected and transformed in certain ways), and it did admirably. I had never used blender before, and it would have taken me hours otherwise.
- oxygen_crisis 3y agoIf you can't write the code yourself, you're not a good judge of how competent it is. If you admire any code that simply works at all when you don't know how it should be done, then your admiration isn't a measurement worth considering. Ask an LLM how to do something you already know very well how to do properly, only then can you see its flaws through its mindless bravado.
- Me1000 3y agoThis doesn’t ring true for me. I have ChatGPT write code for me that I could write myself. I’ve had ChatGPT even rewrite code for me to make it more legible. It’s pretty good at it, especially when it comes to more popular languages.
- lastangryman 3y agoWith all the those leetcode-style interviews and dynamic programming problems in the interview process, surely the genius "Googlers", the worthy few, that make it through this process wouldn't need to use AI to generate code.
- comboy 3y agoI guess it's sarcasm, but if you are experienced and have project loaded in your mind you also don't need to use code completion. Stuff like copilot feels to me like a stronger code completion.
- redbell 3y ago> Cautioning its own workers not to directly use code generated by Bard undermines Google's claims its chatbot can help developers become more productive The definitive definition of irony o_O This reminds me of two pictures that were circulating on social media a while ago. The first was Zuckerberg holding a book while billions of people are wasting their time in endless scrolling in the Metas; the second was that Turkish chef known as Burak eating a healthy lite salad. The bottom line is that we sell stuff that we are not convinced to consume.
- deleted 3y ago[deleted]
- lynx23 3y agoDrug dealers have figured this out long ago. Never get high on your own stuff... No surprise this is the same with tech.
- Lacerda69 3y agoSmoking crack /= using your own software. In fact i would recommend every dev to use their own stuff, "dogfooding" helps a lot to improve the product.
- TeMPOraL 3y agoThe thing you're dogfooding isn't exactly what's being sold - it's missing the layers of crack that get added so the product makes more money.
- soultrees 3y agoThis is less of a productivity risk than a legal risk. Nobody is denying that these tools enable productivity like we haven’t seen before, but google is afraid of outputting protected code while the courts haven’t fully decided the stance on things. Imagine Google Bard outputs a piece of code for a major new feature, making them a shit ton of money. It’s then found out that code was actually taken copied, almost directly from average Joe’s hobby app, and now you’ve got a situation on your hands. Amazing for the average joe who’s expected to get a big pay day if the courts ruled in his favour but less so for the business owner. Frankly, I can’t wait to see what happens when all copyright is out of the window. Obviously within reason, but wait until you see the innovation that comes about when the gates are open. The free-for-all of ideas is a fun time to live in that’s for sure.
- skilled 3y agoThe irony being that Google is releasing disruptive AI features and enforcing them on users, all the while telling their employees not to use these features because they are dogshit and inaccurate.
- deleted 3y ago[deleted]
- alexhjones 3y agoThis isn’t referring to Google’s code generation tool DuetAI / Codey though, it is referring to their general chatbot which is not marketed as a code generation tool. If they issued this for DuetAI it would be a bigger deal.
- deleted 3y ago[deleted]
- skc 3y agoCurious to know if Bard regurgitates the Quake code that everyone was up in arms about over ChatGPT a few months ago
- davidgerard 3y agoDo we know Github's policy on internal use of Copilot?
- alexhjones 3y agoThe equivalent would be GitHub’s policy on employees using Bing for code generation, not copilot.
- davidgerard 3y agoThat's nice. What precisely is Github's policy on using Copilot internally?
- kazinator 3y agoThis is a pure publicity stunt, in order to keep Bard in the news. "Hey world, Bard can generate code so well now, we have to restrain our people from using it!" Something totally transparent can come out of Google after all.
- comfortabledoug 3y agoDon't worry, Bard doesn't actually generate useable code.
- IshKebab 3y ago> Nuance voice AI startup Is a 30 year old company with over $1bn in revenue still a startup?
- mbar84 3y agoI do wonder if Google included their own monorepo codebase in the training data.
- agentcoops 3y agoIt’s a very important question. There are of course two obvious readings/real concerns: (1) the untested IP issues concerning models trained on code from outside the firm, (2) the possibility of unreliable code. From my experience working with LLMs heavily since January, I would articulate my philosophy as “LLMs cannot be authors” — this is just to say, “authorship” is less about having actually created or having done the work, but being legally liable which is to say having skin in the game. Assuming for a second IP issues are not a concern, my rule for developers (or content creators) post-GPT: “you now have more responsibility for errors in your code than before, use whatever tools allow you to be most certain.” I hope that this is the world we are entering, not of generalized irresponsibility or irrelevance of humans in an automated world, but that we finally focus on what we decide really needs doing (thus of course that deciding itself) and taking responsibility that it be done as best as possible, however that may be.
- simple10 3y agoDoes anyone get the feeling this article was written by AI? > The policy isn't surprising, given the chocolate factory also advised users not to include sensitive information in their conversations with Bard "Chocolate factory"??
- PurpleRamen 3y agoSearching for it, it seems to be a nickname for Googles Mountain View HQ, in reference to Willy Wonka and his busy little Workers. And it seems to be around for around a decade, so it's probably not some trap to troll AIs.
- shaftoe444 3y agoLongstanding Register nickname for Google.
- GuB-42 3y agoIf anything, that would be the sign of the article not being written by an AI. There is nothing in the context of the article related to chocolate factories. AIs usually don't just put random words in an otherwise mostly fine article. AI tends to have the opposite problem. The form is good, the words go well together, but it is nonsense when you look at the big picture.
- johnwheeler 3y agoAs we all know, bard sucks really bad right now even compared to Gpt3. For those in the know, how far behind is Google from Open AI? how far behind is LLama?