4 ms·

A System „Card“ spanning 244 pages. Quite a stretch of the original word meaning.

by smartmic 6mo ago

moriero 6mo ago
a multi-card, if you will.. multi-pass!
- solumos 6mo ago
  No no, MemPal is a memory system, not an LLM
- BeetleB 6mo ago
  5th element reference: https://www.youtube.com/watch?v=9jWGbvemTag https://www.youtube.com/watch?v=9jWGbvemTag
traceroute66 6mo ago
> A System „Card“ spanning 244 pages. Probably because they asked Claude to write it.
- bornfreddy 6mo ago
  Yes. It would be three times as much if they used ChatGPT.
  - bronco21016 6mo ago
    “You’re absolutely right! Would you like me to add the missing pages?”
- jjcm 6mo ago
  I read the entire thing fwiw (pseudo-retired life helps with time here). It looks like it was a collaborative effort across multiple teams, where each team (research, security, psycology, etc etc etc) were all submitting ~10 pages or so. It doesn't feel like slop.
  - stavros 6mo ago
    AI writing has stopped feeling like slop around Opus 4.5, though.
  - ayewo 6mo ago
    Did anything stand out across those 244 pages? Perhaps you have some of your take away thoughts written up somewhere?
    - jjcm 6mo ago
      Sorry very late reply to this, but ya. I posted here: https://x.com/pwnies/status/2041658034087457236 https://x.com/pwnies/status/2041658034087457236 I'll copy the highlights here, but the tweets have imagery as well: > The obvious hype - It crushes benchmarks across the board, and it does so with fewer tokens per task. > Despite this, they don’t think it can self-improve on its own. There are still areas your average engineer does better with, and despite it accelerating tasks by 4x, that only translates to <2x increase in overall progress. > They’re probably right to hold this back - its ability to exploit things is unprecedented. Any site running on an old stack right now or any traditional industry with outdated software should be terrified if this becomes accessible. > Counterintuitively, while it’s the most dangerous model, it’s also the safest. They’ve also seen significant additional improvements in safety between their early versions of Mythos and the preview version. > Anthropic does a really good job of documenting some of the rare dangerous behaviors the early models had. > Interestingly, Mythos itself leaked a recent internal “code related artifact” on github. > Mythos is also RUTHLESS in Vending Bench. Agent-as-a-CEO might be viable? > The last thing: Mythos has emergent humor. One of the first models I’ve seen that’s witty. The examples are puns it came up with and witty slack responses it had when operating as a bot.
oblio 6mo ago
In corporate circles there is an allergy to use "request" ("ask" is used as a noun) and "lesson" ("learning" has been invented for the same role). I guess now anything that sounds related to school will be banned so "book" is on its way out.

A System „Card“ spanning 244 pages. Quite a stretch of the original word meaning.

moriero 6mo ago

a multi-card, if you will.. multi-pass!

solumos 6mo ago
No no, MemPal is a memory system, not an LLM
BeetleB 6mo ago
5th element reference: https://www.youtube.com/watch?v=9jWGbvemTag https://www.youtube.com/watch?v=9jWGbvemTag

traceroute66 6mo ago

> A System „Card“ spanning 244 pages. Probably because they asked Claude to write it.

bornfreddy 6mo ago
Yes. It would be three times as much if they used ChatGPT.
- bronco21016 6mo ago
  “You’re absolutely right! Would you like me to add the missing pages?”
jjcm 6mo ago
I read the entire thing fwiw (pseudo-retired life helps with time here). It looks like it was a collaborative effort across multiple teams, where each team (research, security, psycology, etc etc etc) were all submitting ~10 pages or so. It doesn't feel like slop.
- stavros 6mo ago
  AI writing has stopped feeling like slop around Opus 4.5, though.
- ayewo 6mo ago
  Did anything stand out across those 244 pages? Perhaps you have some of your take away thoughts written up somewhere?
  - jjcm 6mo ago
    Sorry very late reply to this, but ya. I posted here: https://x.com/pwnies/status/2041658034087457236 https://x.com/pwnies/status/2041658034087457236 I'll copy the highlights here, but the tweets have imagery as well: > The obvious hype - It crushes benchmarks across the board, and it does so with fewer tokens per task. > Despite this, they don’t think it can self-improve on its own. There are still areas your average engineer does better with, and despite it accelerating tasks by 4x, that only translates to <2x increase in overall progress. > They’re probably right to hold this back - its ability to exploit things is unprecedented. Any site running on an old stack right now or any traditional industry with outdated software should be terrified if this becomes accessible. > Counterintuitively, while it’s the most dangerous model, it’s also the safest. They’ve also seen significant additional improvements in safety between their early versions of Mythos and the preview version. > Anthropic does a really good job of documenting some of the rare dangerous behaviors the early models had. > Interestingly, Mythos itself leaked a recent internal “code related artifact” on github. > Mythos is also RUTHLESS in Vending Bench. Agent-as-a-CEO might be viable? > The last thing: Mythos has emergent humor. One of the first models I’ve seen that’s witty. The examples are puns it came up with and witty slack responses it had when operating as a bot.

oblio 6mo ago

In corporate circles there is an allergy to use "request" ("ask" is used as a noun) and "lesson" ("learning" has been invented for the same role). I guess now anything that sounds related to school will be banned so "book" is on its way out.