3 ms·
This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque? You can just run "air gapped" inference? Is this only of inter
by echelon 6mo ago
This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque?
You can just run "air gapped" inference?
Is this only of interest to enterprise customers already on AWS (who want "air gapped" behavior)? Is there any other use case for this?
This will be more expensive than calling OpenAI directly, right?
- londons_explore 6mo agoThis is for people who don't trust openAI with their data, but do trust Amazon. But it also is for Devs in a company who already have a blanket agreement with Amazon, but would have an uphill battle signing an agreement with openAI.
- kube-system 6mo agoA lot of companies already have data processing agreements and compliance sign-off for using AWS. Many are hesitant to send their data to AI startups with an incentive to train their models and a history of being.... loose with how they intake training data. Even when they do give assurances otherwise. AWS is more trusted in this aspect. If this ends up similar to Claude on Bedrock, it's the same price.
- InvidFlower 6mo agoNo, you definitely don't have access to the weights. The raw weights are secret enough that when a model hits a certain level of capability, their guidelines are that they need enough procedures in place to try to keep nation states from being able to hack in and steal the weights. I think cost is fairly similar. As for who wants it, enterprise stuff is a big thing, but it also seems very reliable. Have never had any rate restrictions or had it just be down, which it sounds like a lot of people have issues with for Anthropic's servers.
- moulick 6mo agoCost of using Anthropics models is same wether buying from AWS or Anthropic directly, Most likely OpenAI models will be the same