15 ms·
Samsung bans use of A.I. like ChatGPT for employees
- johnea 3y agoTotally uninformative article. What "misuse"? This is more of a sound bite than news, there's no information content...
- SushiHippie 3y agoFunnily enough our company will start to roll out an internal ChatGPT UI with an agreement with Azure on not to use the data for training etc, where we would be allowed to share internal data.
- LeifCarrotson 3y agoProbably best to nip "shadow IT" in the bud with an easy-to-use approved internal ChatGPT connection, rather than hoping that employees don't try make use of the tool surreptitiously. Samsung may attempt to ban use of the tool for their employees because they're worried about loss of internal data, but when the tool hugely reduces the workload of those employees, they'll find a way to use it anyways.
- wahnfrieden 3y agothey will use the azure services.
- ajcp 3y agoYou mean Azure OpenAI Service with the ChatGPT (preview) enabled [1]? We've been using it for a couple months now; it's lovely. 1. https://learn.microsoft.com/en-us/azure/cognitive-services/openai/chatgpt-quickstart?tabs=command-line&pivots=programming-language-studio https://learn.microsoft.com/en-us/azure/cognitive-services/o...
- SushiHippie 3y agoProbably, does it have a GUI on its own, or is this something every company needs to implement themselves?
- ajcp 3y agoThe service has a Studio[1] where users can utilize the Chat capabilities. Our understanding (and approach) has been to utilize this to curate and train the GTP models and capabilities and then expose those to the wider org via other, already utilized UI (like MS Teams). 1. https://learn.microsoft.com/en-us/azure/cognitive-services/openai/media/quickstarts/chatgpt-playground-load.png https://learn.microsoft.com/en-us/azure/cognitive-services/o...
- dgwight 3y agoI am looking into open sourcing a PWA ChatGPT client for this. But I am not certain how to handle authentication without a backend or each user needing to add their OpenAI key
- jeremycarter 3y agoI am also working on a similar solution. How far did you get?
- mysterydip 3y agoJust curious, what's the penalty if it is used for training or other things (purposely or accidentally)?
- Silverback_VII 3y agohow to do they use the data for training? Will my questions about the optimal shape of a dildo be remembered forever?
- jstarfish 3y ago"As an AI language model, I am prohibited from instructing you to fuck yourself."
- davely 3y agoJust rolled it out internally at our company as well. It’s nice to have access to GPT-4 without having to pay for it myself (those queries and responses get pricey if you use it a lot). Super helpful for boilerplate code. Right now, we have a limit of 500 tokens though, so it somewhat limits asking more complex questions. Interestingly, our internal team supporting it has added a ton of initial prompts depending on what vertical of our business you want to ask about. Kind of neat, as I haven’t tried to get the AI to pretend to be something else as of yet. (Because I mostly just ask it to write various things to the tune of the “Fresh Prince of Bel Air”)
- subroutine 3y agoHow did you get access to GPT4? Were you guys already using the 3.5 model and get upgraded at some point?
- davely 3y agoI actually don’t know. We just rolled out access to LLMs internally for the first time within the last week and both models were present when I was granted access.
- ParetoOptimal 3y ago> Just rolled it out internally at our company as well. It’s nice to have access to GPT-4 without having to pay for it myself (those queries and responses get pricey if you use it a lot). When you say use it a lot do you mean typing in queries yourself or programatically and/or recursively generating prompts like autogpt? Because I thought one day I had used it a lot by typing in lots of messages. The next day my usage was less than a few dollars.
- croes 3y agoHow would you recognize if they use your data?
- rs999gti 3y agoExactly, can your lawyer or legal department ask for documented proof that you did not contribute to training data?
- sebzim4500 3y agoThe same way you would recognize if Google was selling your GSuite data or Msft was selling your Office data.
- yawnxyz 3y agoAren't you still just trusting that they won't "accidentally leak" all that data to OpenAI for training?
- sometimez 3y agoAfter skimming through the article it's not too clear to me what the misuse was. My best guess is entering "personal or company related information into the services"?
- throwawaysleep 3y agoOriginal incident was a month ago: https://www.pcmag.com/news/samsung-software-engineers-busted-for-pasting-proprietary-code-into-chatgpt https://www.pcmag.com/news/samsung-software-engineers-busted... Basically sensitive code got spat out later.
- mrkramer 3y ago>My best guess is entering "personal or company related information into the services"? I'm not really familiar exactly on how ChatGPT works but does it get trained on input data(search queries)? People are also "leaking" their personal information to Google when they search for something personal like health issues, financial issues, family issues etc. What is the privacy policy of these chatbots afer-all?
- mediaman 3y agoChatGPT does use input as training. The OpenAI API has a policy to not use input as training data. Azure also offers the API with an agreement not to use it for training.
- gumballindie 3y agoSoftware companies must be leaking code on a massive scale right now.
- Bhilai 3y agoNot only code, I have heard horror stories of employees uploading regulated customer data to Open AI.
- andy_ppp 3y agoThere’s a ~3000 word prompt limit so while it’s bad whole user datasets are unlikely to have been uploaded… the issue will come when ChatGPT work out how to do live training from prompts and other user interactions, I suppose it will be filtered but nothing is 100%.
- rst 3y agoDoesn't necessarily apply to data being processed with plugins. The "Code Interpreter" plugin lets you upload files up to 100 MB for use by AI-generated Python scripts; see https://www.oneusefulthing.org/p/it-is-starting-to-get-strange https://www.oneusefulthing.org/p/it-is-starting-to-get-stran... for examples (including useful output from vague prompts like "please characterize this dataset", at least if you get lucky).
- jeroenhd 3y agoThere was a "Show HN" post on here that was planning on using this type of AI to help doctors, basically letting them pipe their patients' medical data into an online AI chat. The way basic privacy and secrecy is ignored in this space is staggering.
- gumballindie 3y agoThe whole space is built around it. The reason is simple. These machine learning systems need massive amounts of data to calibrate for accuracy. They are not intelligent to somehow learn on their own. So machine learning companies have figured they can do an aggressive marketing campaign to make people think these are intelligent and uncontrollable to mask their never ending hunger for our data, hoping everyone is ignorant enough not to catch on. What remains to be seen is whether we come back to our senses soon enough. A lot of “experts” working in ai are warning about dangers but what they omit telling is that it’s the humans who own ai that are dangerous.
- BearOso 3y agoAs of now, these chatbots still make some subtle, egregious errors in code that could easily create more bugs than handwriting if you don't thoroughly audit the output. It's wise to ban them until they improve or naive users get more instruction how to use them properly. And from experience with some Samsung products, they could do with tightening up their code QA standards a bit.
- jstarfish 3y agoAlways append "...and include a passing unit test" to code prompts. Sometimes it's a dick and will test the assertion that 1==1 though.
- zer0tonin 3y agoChatGPT can perfectly return faulty code, and a unit test that runs this faulty code and outputs green
- davely 3y agoI treat it the same was as a code review. Makes it easy to generate a bunch of boilerplate code, but still want to verify it. (Just as I would if it was something I found on Stack Overflow.)
- snotrockets 3y agoCode reviews aren't meant to prove correctness. When I review code, I assume the author thought about it, realized this is the best solution, and tested it, all not happening with the models.
- davely 3y agoHonest question -- what are you doing otherwise then? Just checking for typos in variable names?
- snotrockets 3y ago
- 40acres 3y agoThe market is definitely there for enterprise LLMs. Everyone is using GPT for work. I use it to provide stubs for memos and to brainstorm - but the real value comes from replace internal “tribal knowledge” with an AI who knows your org in and out.
- mrkramer 3y ago>The market is definitely there for enterprise LLMs. Also in the news: https://www.cnbc.com/2023/05/02/chegg-drops-more-than-40percent-after-saying-chatgpt-is-killing-its-business.html https://www.cnbc.com/2023/05/02/chegg-drops-more-than-40perc... >but the real value comes from replace internal “tribal knowledge” with an AI who knows your org in and out I bet Microsoft is already working on that.
- fakedang 3y agoWe already have something developed like that in our company (~30 pax employee owned wealth management firm). It's.... interesting. We currently use GPT-4 combined with an internal knowledge base we had earlier since the beginning, and we practically have to fire our chief of staff and the admin team. Just kidding, but it's made her team's work a ton easier that she can devote more time to the nitty-gritty hard stuff. The interesting part is that I had a bit of a personality touch added as part of its context, so the AI's character is quite.... villainous. Enterprise self-hosted ChatGPT is going to be huge.
- jeremycarter 3y agoI am about to release a self hosted GPT that works with OpenAI and Azure OpenAI. It has several enterprise features, mostly around authentication/authorisation. I'll let you know when it drops or you can be a beta tester if you like!
- fakedang 3y agoNoted. Just a few questions, what do you mean by "works with OpenAI"? I thought those were closed systems, so is the system basically pretrained and the weights saved? I'm pretty sure that if it were even possible, it would still be misuse per their terms and conditions? Currently we use an initial semantic search for context injection, which is then passed to GPT for completions. If any LLAMA company were to make that second pretrained bit self-hostable for some license fee, I know a bunch of companies in finance of all sizes which would readily pounce on that tool. But I'm fairly certain that's not what Open AI wants to do.
- jmount 3y agoThe code remains wrong. For n=1 it cycles forever.
- xerxesaa 3y agoI hear from my former colleagues at Amazon that they have done the same.
- Pbhaskal 3y agoSame happened in Nokia now.
- satvikpendem 3y agoI'm working on an open source enterprise self-hosted LLM integration, pretty sure many people are these days. The difference will be on the business side, rather than the LLM side, as they are quickly becoming commoditized, at least on the open source side, since they are free to use by anyone. I'd also say that one needs a moat in order to succeed; you can't just provide the LLM, since anyone can do that, you need to provide something more that works even without any AI at all.
- croes 3y agoCan the NSA demand access to all the data send to OpenAI? I guess yes. Can they enforce code injections to create backdoors, like they tried with cryptography?
- mellosouls 3y agoCompanies banning the use of ChatGPT level tools going forward will find the rules either flouted, subverted or the employees going elsewhere. Of course there is a duty on employees to be professional - the latter will be the ones taking up opportunities at non-legacy/dinosaur corporations that think they can command the waves. The answer is to sort your processes, security and training out - new AI is here to stay, and managers cannot stop employees using game-changing tools without looking very foolish and incompetent.
- bretticus 3y agoWhy? It’s a valid concern in my opinion. You’re feeding OpenAI your intellectual property and just hoping they don’t do anything with it. I have the same concerns with Microsoft’s TypeScript playground
- Karawebnetwork 3y agoIt is a valid concern if you send an entire list of confidential data and ask it to transform that list. However if you ask ChatGPT some questions about coding in general it's no different than searching online.
- DANmode 3y agoUnless you feed it your proprietary code — something Samsung chip fabrication employees actually did.
- makeitdouble 3y agoThis comes down to whether you trust your whole organization to act be educated about these issues and be good at judging what's ok. At the size of Samsung that's just an impossible move, and it's easier to blanket ban a problematic service and have employee request exceptions justifying their use case. BTW I've been in companies that blanket ban posting stuff online, and got posts security reviewed when asking help on vendor community forums. That's totally a thing.
- golergka 3y ago
- johnea 3y agoThat's maybe the worst written news I've ever read. It's 2 sentences repeated 3 time. What exactly is "misuse"? News for the ADHD...
- eimrine 3y agoI think any use of GPT or Copilot is a misuse for companies like Samsung. Let one idiot to ask questions about little chunks of code and another idiot uploads a full codebase.
- ftxbro 3y agoI wonder if Samsung would partner with the government of South Korea to make their own LLM.
- dwighttk 3y agoWhat was the misuse… I couldn’t find it in that very awkward article.
- SV_BubbleTime 3y agoAgreed, what it came to the comments for. Seems very questionable to not make a single claim about how GPT was “misused”. Without a claim, it seems like narrative.
- pixelbath 3y ago> Bloomberg reported on Tuesday that some staff had uploaded sensitive code to ChatGPT. Which, honestly, is a better article and states the issue outright: https://www.bloomberg.com/news/articles/2023-05-02/samsung-bans-chatgpt-and-other-generative-ai-use-by-staff-after-leak https://www.bloomberg.com/news/articles/2023-05-02/samsung-b...
- blondie9x 3y agoNeed legislation to limit and control what data goes into LLMs. People need to be paid or at least always have a choice when it comes to being input for training data.
- hospitalJail 3y agoI've been looking for a way to obsfuctuate my code. variable names, constants, column names, etc... Havent found something that works in 1 click.
- kypro 3y agoI'm not suggesting the concerns aren't valid, but I guess I don't understand why this same principal isn't applied to other internet connected / cloud software? Do these companies worry that web browsers like Chrome could leak data or applications like Google Docs? What is it about an AI chat bots that makes the risk of a data leak so much higher? Is something about OpenAI's ToS? Or it's relative infancy?
- Aeolun 3y agoData that you send in is used to train the model again later. Companies are happy for their competitors data to show up, but not so much their own.
- huseyinkeles 3y agoThat’s because OpenAI can use any data that you send to chatgpt for training purposes. [0] They don’t do it with their APIs btw. “(c) Use of Content to Improve Services. We do not use Content that you provide to or receive from our API (“API Content”) to develop or improve our Services. We may use Content from Services other than our API (“Non-API Content”) to help develop and improve our Services. You can read more here about how Non-API Content may be used to improve model performance.” [0] https://openai.com/policies/terms-of-use https://openai.com/policies/terms-of-use
- LightBug1 3y agoI'm increasingly p1ssed off by the name "OpenAI"...
- mise_en_place 3y agoReminiscent of the Open Group, or don’t be evil.
- battles 3y agoIf you think of it more as opening Pandora's box rather than open source then it's easier to swallow.
- unethical_ban 3y ago>ChatGPT is a viral AI chatbot that is trained on huge amounts of data and is able to generate response to user queries. It is a form of so-called generative AI. The lazy use of viral when talking about computer tech here annoys me slightly.
- Pbhaskal 3y agoOne of my colleague was pasting parts of /var/log/messages into chatGPT trying to debug some sshd related issue. Is this safe? He said he was masking hostnames before pasting, would that help here?
- nmca 3y agoMy advice to anyone running a company atm - don't let your IT security folks do this. They will initially want to, and it will be a huge mistake.
- LightBug1 3y agoWhy?
- acchow 3y agoPeople will find insecure workarounds which add vulnerabilities.
- skyyler 3y agoThis right here. People have tasted the fruit of the tree of (machine) knowledge. They're not going to let a simple webfilter stop them.
- fzeroracer 3y agoThen you fire them and sue them for leaking confidential information. It doesn't matter if they have a checkbox saying 'we totally won't save your information we promise', no one should be shoveling confidential data into ChatGPT and if people keep doing so then they're a security risk.
- acchow 3y agoHow will you catch them?
- mfer 3y agoAre you suggesting companies put their company confidential information into a system that will use it for training and other purposes?
- teaearlgraycold 3y ago
- dahwolf 3y agoSome commenters are needless making this an all or nothing situation. Using AI in a way that doesn't share your company secrets and private code with the entire world is around the corner or already partially possible. Very obviously Samsung will not ban AI as a whole forever.
- kingsloi 3y agoHow about outside of any workflows, and just one off? I've used ChatGPT twice recently after spending a good amount of time Googling around and finding nothing (specifically https://chatgptonline.ai/chat/ https://chatgptonline.ai/chat/), generalising the statements/removing any/all real data. 1. given the following string [...], build me a regex that extracts the [abc] before [`], until the 2nd [xyz], used for extracting a bunch of info from an array 2. give me a list of common beneficiaries, then give me 5 more Took an hour or so of Googling, then about 10 mins to find an online/open ChatGPT prompt, and about 2 mins to implement the answer in my code. But that's where I draw the line, I'll never use an editor that uses AI in my actual IDE, or expose my code openly to train models
- rr808 3y agoMy big bank employer banned CGPT pretty quickly. Even bing.com is blocked now.
- nextworddev 3y agoThey will eventually end up switching to some Azure based ChatGPT that's 'private', along those lines.
- deleted 3y ago[deleted]
- loeg 3y agoWe have the same guidance at Facebook. Don't put company data into ChatGPT.
- known 3y ago[dead]
- ben7799 3y agoMy employer (big tech co using AI internally already) just blocked it too. They put out a very well thought out explanation why. We're investigating standing up our own internal model for internal use to control any risk of our IP leaking out and to be able to vet the training data. I see lots of casual mention of using it for assistance in writing code.. we view that as fairly dangerous in terms of the risk of accidentally including snippets of open source code. There are many risks to this. Personally my own experimentation (for coding) was pretty ambivalent as to what it can/could actually speed up. Chat GPT is not that fast and it takes time to keep refining what it sends back to you. The window of what it actually helps with seems small right now.