3 ms·
What actually is a "system card"? When I hear the term, I'd expect something akin to the "nutrition facts" infobox for food, or maybe the fee sheet for a credi
by lxgr 2y ago
What actually is a "system card"?
When I hear the term, I'd expect something akin to the "nutrition facts" infobox for food, or maybe the fee sheet for a credit card, i.e. a concise and importantly standardized format that allows comparison of instances of a given class.
Searching for a definition yields almost no results. Meta has possibly introduced them [1], but even there I see no "card", but a blog post. OpenAI's is a LaTeX-typeset PDF spanning several pages of largely text and seems to be an entirely custom thing too, also not exactly something I'd call a card.
[1] https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ https://ai.meta.com/blog/system-cards-a-new-resource-for-und...
- xg15 2y agoMore generally, who introduced that concept of "cards" for ML models, datasets, etc? I saw it first when Huggingface got traction and at some point it seemed to have become some sort of de-facto standard. Was it an OpenAI or Huggingface thing?
- nighthawk454 2y agoPresumably it's a spin off of Google's 'Model Card' from a few years back https://modelcards.withgoogle.com/about https://modelcards.withgoogle.com/about
- xg15 2y agoAh, wasn't aware it was from Google. Thanks!
- Imnimo 2y agoTo my knowledge, this is the origin of model cards: https://arxiv.org/abs/1810.03993 https://arxiv.org/abs/1810.03993 However, often the things we get from companies do not look very much like what was described in this paper. So it's fair to question if they're even the same thing.
- lxgr 2y agoNow that looks like a card, border and bullet points and all! Thank you!