3 ms·

> And lets not even talk, the lack of compliance in an enterprise environment, and as they defer to providers on that... A middleman that adds compliance & reg

by beambot 2mo ago

> And lets not even talk, the lack of compliance in an enterprise environment, and as they defer to providers on that... A middleman that adds compliance & regulation while skimming a slice off the top for themselves: You just described credit cards - stripe's core business...

trollbridge 2mo ago
Very much the same line of business as Amazon Bedrock except OpenRouter gives more options (choice of where hosted, data retention options and so on).
- johnbarron 2mo ago
  >> choice of where hosted, You dont understand Bedrock fundamental use case.
  - trollbridge 2mo ago
    Yeah I do. You can get data locality in GovCloud, a U.S. data centre, or even EU regions. It’s governed by your master AWS agreement (which will make your compliance officer happy), and billing is also conveniently handled by AWS. Of course the Chinese models on it are rotten old and not cheap. But if you want to configure an app to use inference that is entirely controlled, it’s the next best thing to running local.
    - root-parent 1mo ago
      Most important... - Your inputs are within the security boundary of your AWS account or AWS accounts Can OpenRouter say the same? - NO - Your inputs are not shared with models creators Can OpenRouter say the same? - NO - Your inputs are not used to train the next model Can OpenRouter say the same? - NO - Within certain limits and certain models: "50.10.1. Subject to the limitations in this Section 50.10, AWS will defend you and your employees, officers, and directors against any third-party claim alleging that the Generative AI Output generated by an Indemnified Generative AI Service infringes or misappropriates that third party’s intellectual property rights, and will pay the amount of any adverse final judgment or settlement." Can OpenRouter say the same? - NO
      - nh2 1mo ago
        > Within certain limits and certain models For those that hadn't read yet (on https://aws.amazon.com/service-terms/ https://aws.amazon.com/service-terms/): "Certain models" means "only AWS's own trained models" (Nova etc), so not e.g. Bedrock Claude or GPT. "Certain limits" means they don't defent if the input to the model is the IP.
root-parent 2mo ago
How is the middleman going to add compliance if its not the provider of the LLMs? And if that was possible OpenRouter would have done it already...

by beambot 2mo ago

trollbridge 2mo ago

Very much the same line of business as Amazon Bedrock except OpenRouter gives more options (choice of where hosted, data retention options and so on).

johnbarron 2mo ago
>> choice of where hosted, You dont understand Bedrock fundamental use case.
- trollbridge 2mo ago
  Yeah I do. You can get data locality in GovCloud, a U.S. data centre, or even EU regions. It’s governed by your master AWS agreement (which will make your compliance officer happy), and billing is also conveniently handled by AWS. Of course the Chinese models on it are rotten old and not cheap. But if you want to configure an app to use inference that is entirely controlled, it’s the next best thing to running local.
  - root-parent 1mo ago
    Most important... - Your inputs are within the security boundary of your AWS account or AWS accounts Can OpenRouter say the same? - NO - Your inputs are not shared with models creators Can OpenRouter say the same? - NO - Your inputs are not used to train the next model Can OpenRouter say the same? - NO - Within certain limits and certain models: "50.10.1. Subject to the limitations in this Section 50.10, AWS will defend you and your employees, officers, and directors against any third-party claim alleging that the Generative AI Output generated by an Indemnified Generative AI Service infringes or misappropriates that third party’s intellectual property rights, and will pay the amount of any adverse final judgment or settlement." Can OpenRouter say the same? - NO
    - nh2 1mo ago
      > Within certain limits and certain models For those that hadn't read yet (on https://aws.amazon.com/service-terms/ https://aws.amazon.com/service-terms/): "Certain models" means "only AWS's own trained models" (Nova etc), so not e.g. Bedrock Claude or GPT. "Certain limits" means they don't defent if the input to the model is the IP.

root-parent 2mo ago

How is the middleman going to add compliance if its not the provider of the LLMs? And if that was possible OpenRouter would have done it already...