3 ms·

I agree! The concerns must have been very serious indeed to overcome Amazon's strong incentives to not bring them up and let Anthropic keep pulling in the reven

I agree! The concerns must have been very serious indeed to overcome Amazon's strong incentives to not bring them up and let Anthropic keep pulling in the revenue from their new frontier model.

aaronrobinson 5mo ago
Begs the question why they didn’t present that info to Anthropic directly and if they did why they didn’t act
- SpicyLemonZest 5mo ago
  It does. Anthropic mentions (https://www.anthropic.com/news/fable-mythos-access https://www.anthropic.com/news/fable-mythos-access) they consider jailbreaks that "provide no Mythos-specific uplift" to be minor findings; perhaps they couldn't agree on what kinds of capabilities were unlocked by the jailbreak Amazon found.
  - tiahura 5mo ago
    Very questionable and tone deaf response from Anthropic. Irrelevant whether it’s specific to Mythos or Haiku. Dario seems to be looking for an exit.
    - SpicyLemonZest 5mo ago
      As a guy who's historically been a big Anthropic defender, I should acknowledge that I agree with what you're saying and expected a much better response. I have no idea what the underlying jailbreak is or if they're right it's not a big deal, but if you take the power of modern AI seriously, you should be pretty sympathetic to the government's actions here even if you think they got it wrong in this case. (Could the explanation be that Anthropic doesn't take the power of modern AI seriously, and they only pretend to as a marketing strategy towards people like me? I can't rule out the possibility entirely, but I'm still pretty confident it can't be as simple as a deliberate IPO pump and dump, there's too much that doesn't make sense from that angle.)
      - tiahura 5mo ago
        I think the explanation is just ordinary arrogance. “AI is too dangerous for them to develop. We, of course, know what we’re doing.”
ezekg 5mo ago
Or they're trying to hype up an investment...
- SpicyLemonZest 5mo ago
  That doesn't really make sense. If Amazon wanted to build hype, wouldn't they have talked publicly about this? What's the point of working hard on a hype strategy and then delivering it only in private to government officials?
  - throwaway85825 5mo ago
    The export ban exists to hype the capabilities of the much more expensive but only marginally better model.
    - SpicyLemonZest 5mo ago
      The model that they can't currently sell at all because they don't have the capability to limit it to US persons?
      - throwaway85825 5mo ago
        Opus was already rate limited. If the capacity isn't there its better just used for hype.
margalabargala 5mo ago
That's one potential interpretation. There are many others. Hyping an investment, as mentioned. If they have continued access, being able to use the tool when others cannot to get ahead. Amazon's incentives are not so clear or simple as your first interpretation. It's important to think about these things beyond a moment's glance. With practice you will improve!

I agree! The concerns must have been very serious indeed to overcome Amazon's strong incentives to not bring them up and let Anthropic keep pulling in the revenue from their new frontier model.

aaronrobinson 5mo ago

Begs the question why they didn’t present that info to Anthropic directly and if they did why they didn’t act

SpicyLemonZest 5mo ago
It does. Anthropic mentions (https://www.anthropic.com/news/fable-mythos-access https://www.anthropic.com/news/fable-mythos-access) they consider jailbreaks that "provide no Mythos-specific uplift" to be minor findings; perhaps they couldn't agree on what kinds of capabilities were unlocked by the jailbreak Amazon found.
- tiahura 5mo ago
  Very questionable and tone deaf response from Anthropic. Irrelevant whether it’s specific to Mythos or Haiku. Dario seems to be looking for an exit.
  - SpicyLemonZest 5mo ago
    As a guy who's historically been a big Anthropic defender, I should acknowledge that I agree with what you're saying and expected a much better response. I have no idea what the underlying jailbreak is or if they're right it's not a big deal, but if you take the power of modern AI seriously, you should be pretty sympathetic to the government's actions here even if you think they got it wrong in this case. (Could the explanation be that Anthropic doesn't take the power of modern AI seriously, and they only pretend to as a marketing strategy towards people like me? I can't rule out the possibility entirely, but I'm still pretty confident it can't be as simple as a deliberate IPO pump and dump, there's too much that doesn't make sense from that angle.)
    - tiahura 5mo ago
      I think the explanation is just ordinary arrogance. “AI is too dangerous for them to develop. We, of course, know what we’re doing.”

ezekg 5mo ago

Or they're trying to hype up an investment...

SpicyLemonZest 5mo ago
That doesn't really make sense. If Amazon wanted to build hype, wouldn't they have talked publicly about this? What's the point of working hard on a hype strategy and then delivering it only in private to government officials?
- throwaway85825 5mo ago
  The export ban exists to hype the capabilities of the much more expensive but only marginally better model.
  - SpicyLemonZest 5mo ago
    The model that they can't currently sell at all because they don't have the capability to limit it to US persons?
    - throwaway85825 5mo ago
      Opus was already rate limited. If the capacity isn't there its better just used for hype.

margalabargala 5mo ago

That's one potential interpretation. There are many others. Hyping an investment, as mentioned. If they have continued access, being able to use the tool when others cannot to get ahead. Amazon's incentives are not so clear or simple as your first interpretation. It's important to think about these things beyond a moment's glance. With practice you will improve!