5 ms·
If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two si
by ykl 4mo ago
If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons:
1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship
2. Large companies tend to have strong internal requirements about making sure that internal data stays under company control. With AWS Bedrock, you can be a lot more confident that what you're feeding into the models is not going to end up in someone's training set somewhere. For where I work, this requirement is a dealbreaker for going directly through OpenAI's API instead of going through AWS Bedrock.
- rho138 4mo agoHow is one certain bedrock data isn’t being shuttled to external providers?
- cortesoft 4mo agoContracts and the force of law?
- ai_fry_ur_brain 4mo ago[flagged]
- SOLAR_FIELDS 4mo agoActually yes, when it’s other huge corporations holding them accountable. It’s only when politicians who are much more cheaply bought get involved that creates problems. When the other side has a significant war chest to combat you with, suddenly behavior improves
- ch4s3 4mo agoAny sufficiently large company will be prepared to fight this out in court where Amazon would eventually lose.
- deleted 4mo ago[deleted]
- harrall 4mo agoLaws and rules don’t hold anyone accountable. Anyone can say anything and then break that trust the next second. Instead you trust your best friend because you have known them for 15 years and seen them in enough situations. It’s long term observation and predictability they ultimately gives trust. AWS has been around 20 years and has never once shown a sign that that they would sell customer data. Could they still try? Sure, in the same way they my friend who hates seafood his entire life could suddenly flip 180 and love it. Yeah I guess it’s possible.
- deleted 4mo ago[deleted]
- avianlyric 4mo agoContractual obligation, external third party audits, and above all, AWS’s reputation. AWS isn’t going to risk their reputation, and thus huge chunks of their business, just so a few AI labs can get some extra training data. That’s an insane risk with zero upside for AWS. AWS knows full well they will make insane quantities of cash without breaking legal contracts with companies who pay them billions each year for infra.
- jofzar 4mo agoWhat other people are saying, but also because Amazon does not want to fuck around in this space. They don't want the legal fight or the reputational damage that would come with it.
- trollbridge 4mo agoThey also don't really stand to benefit from doing so, unlike basically everyone else in this space. They have access to a ridiculous amount of private customer data and so far have not shown any predilection to misusing that access.
- xingped 4mo agoTo take an easy example that has actually had lawsuits I can link to, you must be unfamiliar with the lawsuits against Amazon for misusing sellers' data in order to undercut them with their own products... https://www.reuters.com/sustainability/13-bln-uk-lawsuit-accuses-amazon-misusing-small-sellers-data-2024-06-06/ https://www.reuters.com/sustainability/13-bln-uk-lawsuit-acc... There's zero reason to "trust" Amazon about anything. (And yes, I know the retail and AWS sides of the company are different, but it's still the same company. The same rot is always there, just shuffled around.)
- bijowo1676 4mo agothis is not related to AWS, but merely to amazon's retail business and their sellers know and sign up for the deal when they sell via amazon. every single retail company does this, they allow suppliers to sell the product using retails's infrastructure, and then retailer turns around and create private label products using sales data (Costco's Kirkland Signature, Walmart's Great Value, are just some examples)
- fragmede 4mo agoYes, but Kirkland's signature comes from the same factory. If I'm the factory owner and Costco vis going to guarantee me sales albeit at a slightly lower margin, so long as I slap a different sticker on it, that's different than from Amazon finding out which of my products sells best and then gets someone else to rip it off so I don't get paid anything.
- 650REDHAIR 4mo agoBezos and Altman pinky-promised and are super trustworthy.
- azinman2 4mo agoSeems like trusting AWS with your data has been a good bet for a long time. They wouldn’t have the size/scale otherwise.
- SXX 4mo agoBezos is not in AI gold rush. AWS is shovel rental. Also unlike Altman they are trustworthy - a lot of Amazon competitors do run on AWS for decades.
- glzone1 4mo agoYou really don't understand what AWS offers if you think this is what is getting them workloads (including competitors and highly sensitive govt workloads).
- wmf 4mo agoAndy Jassy is actually trustworthy.
- nh2 4mo agoIn contrast to Microsoft, OpenAI, and Anthropic, AWS has never done anything close to sneaking in unwanted training opt-outs after the fact. They are the only ones I trust not to do that so far. And their terms are extremely clear on that, no fuzzy language. Exactly what we want to see. So we use Bedrock.
- kopirgan 4mo agoHaving worked with lots of companies, I can say that trust is there. But true test is competitors of Amazon. Does Walmart use them? Ebay? Although not in exact same business.
- 33MHz-i486 4mo agothey’re crap on a lot dimensions of how they treat customers but data privacy/security is one thats taken pretty seriously at AWS, perhaps owing to the massive reputational damage that would result if they played loose with it.
- deleted 4mo ago[deleted]
- zmmmmm 4mo agoThey could be lying with all this: https://docs.aws.amazon.com/bedrock/latest/userguide/data-protection.html https://docs.aws.amazon.com/bedrock/latest/userguide/data-pr... But it seems tremendously unlikely with how explicit they are being with it. It is clearly one of the top selling features for the service.
- rho138 4mo agoThe only response with an actual link to the docs, thanks homie! Edit: From your source - “You are responsible for maintaining control over your content that is hosted on this infrastructure.” So they don’t.
- Eridrus 4mo agoTo go a step further, the reason it's often impossible to add a new vendor if that you've signed a bunch of contracts with your customers saying you're not going to send their data to other vendors in all sorts of various flavors.
- xtracto 4mo agoAnd the pain of the procurement process, specially when you follow a certification such as iso27001, soc2 or similar.
- Eridrus 4mo agosoc2 is stupidly viral but generally not a blocker since its pretty straightforward to get. It's really the per-customer contractual agreements you had to sign to grow that make things horrible.
- a_bonobo 4mo ago3. from my opportunity - For many (not all) LLMs, Bedrock gives you control over which country the data stays in. You have no control over that with the Claude API, for example. We do not work in the US and have strong requirements for the data to stay in our country, which Bedrock gives us control over.
- regularfry 4mo ago4. AWS billing is already cross-charged to different departments per account. Copilot/Claude/Codex would need that setting up all over again, and is (probably) all coming out of a central bucket right now. Switching to Bedrock APIs is really easy, and solves a problem for people high enough up in the organisation that they can insist on it.
- stymaar 4mo ago> We do not work in the US and have strong requirements for the data to stay in our country, which Bedrock gives us control over. It doesn't actually. The US can request data from whatever country US companies store it, and companies must comply. So if you have strong requirements for data to stay in your country, using a US provider, whatever it is, is out of question no matter what the company's marketing claims (they are not maintaining these claims under oath for what it's worth: https://www.senat.fr/compte-rendu-commissions/20250609/ce_commande_publique.html#:~:text=Microsoft%20est%20soumis%20au,acc%C3%A8s https://www.senat.fr/compte-rendu-commissions/20250609/ce_co... )
- a_bonobo 4mo agoAh yes, there is a gap between what our regulator wants and what the reality is. I have no qualms that they'll hover out the data if they want to, we know that since Snowden. But I have to comply with the regulator, not with reality.
- stymaar 4mo agoThe definition of malicious compliance…
- kopirgan 4mo agoA very interesting comment. Curious to understand how AI will continue to grow if this is the trend. Assuming most valuable data is behind such firewalls. And whatever is public has been harvested, trained on top of whatever has been acquired illegally (this is a grey area). Will it become a closed ecosystem without outside input?!
- kennethops 4mo agoimo it will slowly turn into where people run their own AI
- bitmasher9 4mo agoThe pace of data creation is only increasing, and our capabilities of sharing and storing it is growing as well. Lots of this is out in the open, ready for anyone to crawl and scrape. There probably is a point of “peak data” where the amount of new data will start decreasing, but that’s likely a 22nd or 24rd century problem.
- avianlyric 4mo agoPace of data creation ignores the fact that the majority of the big gains in LLM “intelligence” has come from scraping and feeding in the huge amount of public data that already exists. Unless we’re producing data on the order of an entire new internet every couple of years, then it’s hard to see how LLMs can achieve further huge leaps in capability compared to training on effectively 0% of the internet vs 100% of the internet.
- kopirgan 4mo agoThat is without going into fact that many already use AI to type out and write stuff. I have a customer in Far East that routinely uses it even for simple emails, he is not so familiar with English.
- fragmede 4mo agoThe majority of the gains come from the size of the supercomputers used to train them on. That's still growing. The algorithms used, and how the data is annotated is also some secret sauce.
- CodeNest 4mo ago[dead]