4 ms·

Seriously though, why is it a model "card", safety "card"? I had to lookup to learn that it comes from HuggingFace's vague definition of "README" in the model's

Seriously though, why is it a model "card", safety "card"? I had to lookup to learn that it comes from HuggingFace's vague definition of "README" in the model's repo. This is such a specific thing that I don't think anyone except a very small population would know - not the users, not the c-suites. I don't like Musk or Grok. But not knowing what's a safety card is not a signal of anything IMO.

Barbing 5mo ago
He asked why it would be a card. URL slug of world’s hottest (non-Nvidia?) company: system-cards https://www.anthropic.com/system-cards https://www.anthropic.com/system-cards You’d have to be asleep at the wheel. For years: Claude 2 July 2023 Read system card But users don’t need to know you’re 100% right, you shouldn’t need to know this inside baseball (you didn’t pollute & compute & gain the responsibility).
accrual 5mo ago
> Seriously though, why is it a model "card", safety "card"? My assumption is because "card" has a more formal tone than a README, which is more like a quick "how to use the software" guide. Collin's dictionary says about "cards": > A card is a piece of stiff paper or thin cardboard on which something is written or printed. (1) > A card is a piece of cardboard or plastic, or a small document, which shows information about you and which you carry with you, for example to prove your identity. (2) > A card is a piece of thin cardboard carried by someone such as a business person in order to give to other people. A card shows the name, address, phone number, and other details of the person who carries it. (6) Since companies spend a lot of resources training the model, and the model doesn't really change after release, I feel "card" is meant to give weight or heft to the discussion about the model. It's not meant to be updated like a README or other software documents, it's meant to be handed out to others as a firm, unchanging "this is a summary of the model and its specifications", like a business card for models.
- lukewarm707 5mo ago
  maybe it was from soccer cards. the model gets the yellow card. if it wants to become skynet it gets a red.
aesthesia 5mo ago
The "model card" concept actually comes from a pre-LLM Google paper (https://arxiv.org/abs/1810.03993 https://arxiv.org/abs/1810.03993), where the example cards did fit on a single page. The concept quickly became a standard component of AI governance frameworks, and Hugging Face adopted it as a reasonable standard format for a model README. As LLMs emerged and became more capable at broader ranges of tasks, model cards expanded to the sizes we see today.
- Barbing 5mo ago
  That makes sense. I recall a “battle card“ (“concise, easy-to-scan document that helps [sales] reps handle competitive conversations, respond to objections, and highlight key differentiators” per HubSpot) as about a half sheet document, which is congruent.

Barbing 5mo ago

He asked why it would be a card. URL slug of world’s hottest (non-Nvidia?) company: system-cards https://www.anthropic.com/system-cards https://www.anthropic.com/system-cards You’d have to be asleep at the wheel. For years: Claude 2 July 2023 Read system card But users don’t need to know you’re 100% right, you shouldn’t need to know this inside baseball (you didn’t pollute & compute & gain the responsibility).

accrual 5mo ago

> Seriously though, why is it a model "card", safety "card"? My assumption is because "card" has a more formal tone than a README, which is more like a quick "how to use the software" guide. Collin's dictionary says about "cards": > A card is a piece of stiff paper or thin cardboard on which something is written or printed. (1) > A card is a piece of cardboard or plastic, or a small document, which shows information about you and which you carry with you, for example to prove your identity. (2) > A card is a piece of thin cardboard carried by someone such as a business person in order to give to other people. A card shows the name, address, phone number, and other details of the person who carries it. (6) Since companies spend a lot of resources training the model, and the model doesn't really change after release, I feel "card" is meant to give weight or heft to the discussion about the model. It's not meant to be updated like a README or other software documents, it's meant to be handed out to others as a firm, unchanging "this is a summary of the model and its specifications", like a business card for models.

lukewarm707 5mo ago
maybe it was from soccer cards. the model gets the yellow card. if it wants to become skynet it gets a red.

aesthesia 5mo ago

The "model card" concept actually comes from a pre-LLM Google paper (https://arxiv.org/abs/1810.03993 https://arxiv.org/abs/1810.03993), where the example cards did fit on a single page. The concept quickly became a standard component of AI governance frameworks, and Hugging Face adopted it as a reasonable standard format for a model README. As LLMs emerged and became more capable at broader ranges of tasks, model cards expanded to the sizes we see today.

Barbing 5mo ago
That makes sense. I recall a “battle card“ (“concise, easy-to-scan document that helps [sales] reps handle competitive conversations, respond to objections, and highlight key differentiators” per HubSpot) as about a half sheet document, which is congruent.