EU Artificial Intelligence Act

Article 17 – Quality management system

1.Providers of high-risk AI systems shall put a quality management system in place that ensures compliance with this Regulation. That system shall be documented in a systematic and orderly manner in the form of written policies, procedures and instructions, and shall include at least the following aspects:

(a)a strategy for regulatory compliance, including compliance with conformity assessment procedures and procedures for the management of modifications to the high-risk AI system;

(b)techniques, procedures and systematic actions to be used for the design, design control and design verification of the high-risk AI system;

(c)techniques, procedures and systematic actions to be used for the development, quality control and quality assurance of the high-risk AI system;

(d)examination, test and validation procedures to be carried out before, during and after the development of the high-risk AI system, and the frequency with which they have to be carried out;

(e)technical specifications, including standards, to be applied and, where the relevant harmonised standards are not applied in full, the means to be used to ensure that the high-risk AI system complies with the requirements set out in Chapter 2 of this Title;

(f)systems and procedures for data management, including data collection, data analysis, data labelling, data storage, data filtration, data mining, data aggregation, data retention and any other operation regarding the data that is performed before and for the purposes of the placing on the market or putting into service of high-risk AI systems;

(g)the risk management system referred to in Article 9;

(h)the setting-up, implementation and maintenance of a post-market monitoring system, in accordance with Article 61;

(i)procedures related to the reporting of serious incidents and of malfunctioning in accordance with Article 62;

(j)the handling of communication with national competent authorities, competent authorities, including sectoral ones, providing or supporting the access to data, notified bodies, other operators, customers or other interested parties;

(k)systems and procedures for record keeping of all relevant documentation and information;

(l)resource management, including security of supply related measures;

(m)an accountability framework setting out the responsibilities of the management and other staff with regard to all aspects listed in this paragraph.

2.The implementation of aspects referred to in paragraph 1 shall be proportionate to the size of the provider’s organisation.

3.For providers that are credit institutions regulated by Directive 2013/36/ EU, the obligation to put a quality management system in place shall be deemed to be fulfilled by complying with the rules on internal governance arrangements, processes and mechanisms pursuant to Article 74 of that Directive. In that context, any harmonised standards referred to in Article 40 of this Regulation shall be taken into account.