4 ms·

I will change a few lines of code and use another AI model?

echelon 11mo ago
Are all of their sales their code gen model? And isn't there a lot of competition in the code gen space from Google and Anthropic? I'd imagine they sold these to enterprise: https://openai.com/business/ https://openai.com/business/ "ChatGPT for Business", sold per seat "API Platform" I could see the former getting canned if AI isn't adding value. Developers can change the models they use frequently, especially with third party infrastructure like OpenRouter or FAL.
bangaladore 11mo ago
Yeah- given all top AI models are more and more generalists, as time goes on there is less and less reason to use one over another.
- raw_anon_1111 11mo ago
  It’s really even easier than that. I already do all my work on AWS and use Bedrock that hosts every popular model and its own except for OpenAIs closed source models. I have a reusable library that lets me choose between any of the models I choose to support or any new model in the same family that uses the same request format. Every project I’ve done, it’s a simple matter of changing a config setting and choosing a different model. If the model provider goes out of business, it’s not like the model is going to disappear from AWS the next day.
  - echelon 11mo ago
    > Bedrock This sounds so enterprise. I've been wanting to talk to people that actually use it. Why use Bedrock instead of OpenRouter, Fal, etc.? Doesn't that tie you down to Amazon forever? Isn't the API worse? Aren't the p95 latencies worse? The costs higher?
    - bangaladore 11mo ago
      Bedrock is a lot more than just a standard endpoint. Also, the security guarantees.
    - bibimsz 11mo ago
      on less vendor to vet, one less contract to negotiate, one less 3rd party system to administer. you're already locked into AWS anyway. integrates with other AWS services. access control is already figured out.
    - raw_anon_1111 11mo ago
      Given a choice between being “locked in” to a major cloud provider and trusting your business to a randomish little company, you are never going to get a compliance department to go for the latter. “no one ever got fired for choosing AWS”. This is the API - it’s basically the same for all supported languages https://docs.aws.amazon.com/code-library/latest/ug/python_3_bedrock-runtime_code_examples.html https://docs.aws.amazon.com/code-library/latest/ug/python_3_... Real companies aren’t concerned about cost as much as working with other real companies, compliance, etc and are comparing cost or opportunities between doing a thing and not doing a thing. One of my specialties is call centers. Every call deflected by using AI vs talking to a human agent can save from $5 - $15. Even saving money by allowing your cheaper human agents to handle a problem where they are using AI in the background, can save money. $15 saved can buy a lot of inference. And the lock in boogeyman is something only geeks care about. Migrations from one provider to another costs so much money at even a medium scale they are hardly ever worth it between the costs, distractions from doing value added work, and risks of regressions and downtime.
      - esafak 11mo ago
        > And the lock in boogeyman is something only geeks care about. Migrations from one provider to another costs so much money... You just gave the definition of lock in.
        raw_anon_1111 11mo ago
  - deaux 11mo ago
    Bedrock hosts Gemini models? Incredibly popular, currently SOTA, biggest competitor to OpenAI, those models? I don't think it does.
    - raw_anon_1111 11mo ago
      I forgot to mention that. But funny enough AWS and GCP made a joint announcement that they are introducing a service to let users easily connect the infrastructure of the two providers between their private networks without going over the public internet. https://cloud.google.com/blog/products/networking/aws-and-google-cloud-collaborate-on-multicloud-networking https://cloud.google.com/blog/products/networking/aws-and-go... This isn’t some type of VPN solution, think more like DirectConnect but between AWS and GCP instead of AWS and your colo. It’s posited that AWS agreed to this so sales could tell customers that they don’t have to move their workloads from AWs to take advantage of Google’s AI infrastructure without experiencing extreme latency.

Are all of their sales their code gen model? And isn't there a lot of competition in the code gen space from Google and Anthropic? I'd imagine they sold these to enterprise: https://openai.com/business/ https://openai.com/business/ "ChatGPT for Business", sold per seat "API Platform" I could see the former getting canned if AI isn't adding value. Developers can change the models they use frequently, especially with third party infrastructure like OpenRouter or FAL.

bangaladore 11mo ago

Yeah- given all top AI models are more and more generalists, as time goes on there is less and less reason to use one over another.

raw_anon_1111 11mo ago
It’s really even easier than that. I already do all my work on AWS and use Bedrock that hosts every popular model and its own except for OpenAIs closed source models. I have a reusable library that lets me choose between any of the models I choose to support or any new model in the same family that uses the same request format. Every project I’ve done, it’s a simple matter of changing a config setting and choosing a different model. If the model provider goes out of business, it’s not like the model is going to disappear from AWS the next day.
- echelon 11mo ago
  > Bedrock This sounds so enterprise. I've been wanting to talk to people that actually use it. Why use Bedrock instead of OpenRouter, Fal, etc.? Doesn't that tie you down to Amazon forever? Isn't the API worse? Aren't the p95 latencies worse? The costs higher?
  - bangaladore 11mo ago
    Bedrock is a lot more than just a standard endpoint. Also, the security guarantees.
  - bibimsz 11mo ago
    on less vendor to vet, one less contract to negotiate, one less 3rd party system to administer. you're already locked into AWS anyway. integrates with other AWS services. access control is already figured out.
  - raw_anon_1111 11mo ago
    Given a choice between being “locked in” to a major cloud provider and trusting your business to a randomish little company, you are never going to get a compliance department to go for the latter. “no one ever got fired for choosing AWS”. This is the API - it’s basically the same for all supported languages https://docs.aws.amazon.com/code-library/latest/ug/python_3_bedrock-runtime_code_examples.html https://docs.aws.amazon.com/code-library/latest/ug/python_3_... Real companies aren’t concerned about cost as much as working with other real companies, compliance, etc and are comparing cost or opportunities between doing a thing and not doing a thing. One of my specialties is call centers. Every call deflected by using AI vs talking to a human agent can save from $5 - $15. Even saving money by allowing your cheaper human agents to handle a problem where they are using AI in the background, can save money. $15 saved can buy a lot of inference. And the lock in boogeyman is something only geeks care about. Migrations from one provider to another costs so much money at even a medium scale they are hardly ever worth it between the costs, distractions from doing value added work, and risks of regressions and downtime.
    - esafak 11mo ago
      > And the lock in boogeyman is something only geeks care about. Migrations from one provider to another costs so much money... You just gave the definition of lock in.
      - raw_anon_1111 11mo ago
- deaux 11mo ago
  Bedrock hosts Gemini models? Incredibly popular, currently SOTA, biggest competitor to OpenAI, those models? I don't think it does.
  - raw_anon_1111 11mo ago
    I forgot to mention that. But funny enough AWS and GCP made a joint announcement that they are introducing a service to let users easily connect the infrastructure of the two providers between their private networks without going over the public internet. https://cloud.google.com/blog/products/networking/aws-and-google-cloud-collaborate-on-multicloud-networking https://cloud.google.com/blog/products/networking/aws-and-go... This isn’t some type of VPN solution, think more like DirectConnect but between AWS and GCP instead of AWS and your colo. It’s posited that AWS agreed to this so sales could tell customers that they don’t have to move their workloads from AWs to take advantage of Google’s AI infrastructure without experiencing extreme latency.