Skip to content

Algorithm Reporting Standard

For the Algorithm Management Toolkit (AMT) we were looking for a standardized way to report on algorithmic systems. Inspired by Model Cards for Model Reporting and Papers with Code Model Index the Algorithm Reporting Standard extends the Hugging Face model card metadata specification to allow for:

  1. More fine-grained information on performance metrics.
  2. Capturing additional measurements on fairness and bias, which can be partitioned into bar plot like measurements (such as mean absolute SHAP values) and graph plot like measurements (such as partial dependence).
  3. Capturing assessments (such as IAMA and ALTAI).

More information about the Algorithm Reporting Standard can be found on the GitHub repository github.com/MinBZK/algorithm-reporting-standard. Here you can also find information about the definition of the System Card which contains Model Cards and Assessment Cards.

Algorithm Reporting Standard on GitHUB