Back Share
Strategies

Considerations in assessing trustworthy AI - Reliability and reproducibility

governance-question

“Compliance with this assessment list is not evidence of legal compliance, nor is it intended as guidance to ensure compliance with applicable law. Given the application-specificity of AI systems, the assessment list will need to be tailored to the specific use case and context in which the system operates. In addition, this chapter offers a general recommendation on how to implement the assessment list for Trustworthy AI though a governance structure embracing both operational and management level.” (High-Level Expert Group on AI, 2019, p. 24)“TRUSTWORTHY AI ASSESSMENT LIST (PILOT VERSION) Technical robustness and safety“Reliability and reproducibility- Did you put in place a strategy to monitor and test if the AI system is meeting the goals, purposes and intended applications? - Did you test whether specific contexts or particular conditions need to be taken into account to ensure reproducibility? - Did you put in place verification methods to measure and ensure different aspects of the system's reliability and reproducibility? - Did you put in place processes to describe when an AI system fails in certain types of settings? - Did you clearly document and operationalise these processes for the testing and verification of the reliability of AI systems? - Did you establish mechanisms of communication to assure (end-)users of the system’s reliability?” (High-Level Expert Group on AI, 2019, p. 28)

Overarching Principles Beneficence Merit and Integrity
Title Considerations in assessing trustworthy AI - Reliability and reproducibility