What a provider of a high-risk AI system must do.
The requirements in Articles 9 to 15, and the provider obligations in Articles 16 and 17, of Regulation (EU) 2024/1689. Where a provision has conditions, we quote it and link the article.
Who is a provider
Provider: “a natural or legal person, public authority, agency or other body that develops an AI system or a general-purpose AI model or that has an AI system or a general-purpose AI model developed and places it on the market or puts the AI system into service under its own name or trademark, whether for payment or free of charge” (Article 3(3)).
What a provider of a high-risk system must do
The requirements in Articles 9 to 15, and the provider obligations in Articles 16 and 17.
For high-risk AI systems related to products covered by Section B of Annex I, “only Article 6(1), Article 60a and Articles 102 to 112 shall apply” (Article 2(2)), so the duties below do not apply to them in that form.
“A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems.” The article sets out the steps of that system and its testing (Article 9).
“Training, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the intended purpose.” The article also sets governance practices for those data sets (Article 10).
“The technical documentation of a high-risk AI system shall be drawn up before that system is placed on the market or put into service and shall be kept up-to date” (Article 11(1)). “High-risk AI systems shall technically allow for the automatic recording of events (logs) over the lifetime of the system” (Article 12(1)).
High-risk AI systems “shall be accompanied by instructions for use” (Article 13(2)), and “shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use” (Article 14(1)).
High-risk AI systems “shall be designed and developed in such a way that they achieve an appropriate level of accuracy, robustness, and cybersecurity, and that they perform consistently in those respects throughout their lifecycle” (Article 15(1)).
Article 16 lists the obligations of providers of high-risk AI systems in points (a) to (l), among them compliance with the requirements of Section 2, a quality management system under Article 17, the conformity assessment, the EU declaration of conformity, the CE marking and registration (Article 16). “Providers of high-risk AI systems shall put a quality management system in place that ensures compliance with this Regulation” (Article 17(1)).
Transparency duties
Article 50 applies to providers and deployers of the systems it names, high-risk or not.
Article 50 sets four groups of duties. Providers shall ensure that AI systems intended to interact directly with natural persons are designed so that “the natural persons concerned are informed that they are interacting with an AI system, unless this is obvious from the point of view of a natural person who is reasonably well-informed, observant and circumspect, taking into account the circumstances and the context of use”, an obligation that “shall not apply to AI systems authorised by law to detect, prevent, investigate or prosecute criminal offences, subject to appropriate safeguards for the rights and freedoms of third parties, unless those systems are available for the public to report a criminal offence” (paragraph 1). Providers of AI systems generating synthetic audio, image, video or text content “shall ensure that the outputs of the AI system are marked in a machine-readable format and detectable as artificially generated or manipulated”, an obligation that “shall not apply to the extent the AI systems perform an assistive function for standard editing or do not substantially alter the input data provided by the deployer or the semantics thereof, or where authorised by law to detect, prevent, investigate or prosecute criminal offences” (paragraph 2). “Deployers of an emotion recognition system or a biometric categorisation system shall inform the natural persons exposed thereto of the operation of the system”, except for systems that “are permitted by law to detect, prevent or investigate criminal offences, subject to appropriate safeguards for the rights and freedoms of third parties, and in accordance with Union law” (paragraph 3). “Deployers of an AI system that generates or manipulates image, audio or video content constituting a deep fake, shall disclose that the content has been artificially generated or manipulated”, except “where the use is authorised by law to detect, prevent, investigate or prosecute criminal offence”, and with a lighter duty for “an evidently artistic, creative, satirical, fictional or analogous work or programme” (paragraph 4, first subparagraph). Deployers of an AI system that generates or manipulates text “which is published with the purpose of informing the public on matters of public interest shall disclose that the text has been artificially generated or manipulated”, an obligation that “shall not apply where the use is authorised by law to detect, prevent, investigate or prosecute criminal offences or where the AI-generated content has undergone a process of human review or editorial control and where a natural or legal person holds editorial responsibility for the publication of the content” (paragraph 4, second subparagraph).
More on the AI Act
Ask the AI Act with the source attached
On the free plan, your own AI client searches law and regulation through Ansvar, one jurisdiction or framework per question, and every answer carries its source.
Ask these to see the quality
Paste one into your agent once Ansvar is connected, and check the article it cites.
Using Ansvar, what must a provider of a high-risk AI system do under Article 16 of the EU AI Act? Quote each point you rely on.Using Ansvar, what does Article 9 of the EU AI Act require of the risk management system for a high-risk AI system? Quote the paragraph that sets it up.Using Ansvar, what must a high-risk AI system record automatically under Article 12 of the EU AI Act? Quote the sentence.