3 ms·
Had to track through five links to find out what a "system card" is. It's an instance of a "model card", some broad headings to be filled in.[1] • Model Detail
by Animats 2y ago
Had to track through five links to find out what a "system card" is.
It's an instance of a "model card", some broad headings to be filled in.[1]
• Model Details.
• Intended Use.
• Factors. Factors could include demographic or phenotypic
groups, environmental conditions, technical attributes, or
others
• Metrics.
• Evaluation Data.
• Training Data
• Quantitative Analyses
• Caveats and Recommendations
Meta's PR describes a "system card", but doesn't provide one.[2]
It doesn't, interestingly, seem to include the initial built-in prompts used as constraints.
[1] https://arxiv.org/pdf/1810.03993 https://arxiv.org/pdf/1810.03993
[2] https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ https://ai.meta.com/blog/system-cards-a-new-resource-for-und...
- sigmoid10 2y ago>It doesn't, interestingly, seem to include the initial built-in prompts used as constraints. That's because it is mostly a ploy by profit-driven corporations to allow their researchers to publish some stuff without having them actually reveal anything of value to competitors. Don't be surprised if you find it severely lacking for actual insight.