AI Governance Day
Council of Europe AI Treaty Open for Signature
5 September 2024
The Council of Europe Framework Convention on artificial intelligence and human rights, democracy, and the rule of law (CETS No. 225) was opened for signature during a conference of Council of Europe Ministers of Justice in Vilnius. It is the first-ever international legally binding treaty aimed at ensuring that the use of AI systems is fully consistent with human rights, democracy and the rule of law.
The Framework Convention was signed by Andorra, Georgia, Iceland, Norway, the Republic of Moldova, San Marino, the United Kingdom as well as Israel, the United States of America and the European Union.
Council of Europe Secretary General Marija Pejčinović Burić said: “We must ensure that the rise of AI upholds our standards, rather than undermining them. The Framework Convention is designed to ensure just that. It is a strong and balanced text - the result of the open and inclusive approach by which it was drafted and which ensured that it benefits from multiple and expert perspectives. The Framework Convention is an open treaty with a potentially global reach. I hope that these will be the first of many signatures and that they will be followed quickly by ratifications, so that the treaty can enter into force as soon as possible.”
The treaty provides a legal framework covering the entire lifecycle of AI systems. It promotes AI progress and innovation, while managing the risks it may pose to human rights, democracy and the rule of law. To stand the test of time, it is technology-neutral.
The Framework Convention was adopted by the Council of Europe Committee of Ministers on 17 May 2024. The 46 Council of Europe member states, the European Union and 11 non-member states (Argentina, Australia, Canada, Costa Rica, the Holy See, Israel, Japan, Mexico, Peru, the United States of America and Uruguay) negotiated the treaty. Representatives of the private sector, civil society and academia contributed as observers.
The treaty will enter into force on the first day of the month following the expiration of a period of three months after the date on which five signatories, including at least three Council of Europe member states, have ratified it. Countries from all over the world will be eligible to join it and commit to complying with its provisions.
Council of Europe and Artificial Intelligence
Speech by Secretary General Marija Pejčinović Burić
Speech by Ewelina Dobrowolska, Minister of Justice of the Republic of Lithuania
Council of Europe adopts first international treaty on artificial intelligence (17 May 2024)
The Council of Europe has adopted the first-ever international legally binding treaty aimed at ensuring the respect of human rights, the rule of law and democracy legal standards in the use of artificial intelligence (AI) systems. The treaty, which is also open to non-European countries, sets out a legal framework that covers the entire lifecycle of AI systems and addresses the risks they may pose, while promoting responsible innovation. The convention adopts a risk-based approach to the design, development, use, and decommissioning of AI systems, which requires carefully considering any potential negative consequences of using AI systems.
The Council of Europe Framework Convention on artificial intelligence and human rights, democracy, and the rule of law was adopted in Strasbourg during the annual ministerial meeting of the Council of Europe's Committee of Ministers, which brings together the Ministers for Foreign Affairs of the 46 Council of Europe member states.
Council of Europe Secretary General Marija Pejčinović said: “The Framework Convention on Artificial Intelligence is a first-of-its-kind, global treaty that will ensure that Artificial Intelligence upholds people’s rights. It is a response to the need for an international legal standard supported by states in different continents which share the same values to harness the benefits of Artificial intelligence, while mitigating the risks. With this new treaty, we aim to ensure a responsible use of AI that respects human rights, the rule of law and democracy.”
The convention is the outcome of two years' work by an intergovernmental body, the Committee on Artificial Intelligence (CAI), which brought together to draft the treaty the 46 Council of Europe member states, the European Union and 11 non-member states (Argentina, Australia, Canada, Costa Rica, the Holy See, Israel, Japan, Mexico, Peru, the United States of America, and Uruguay), as well as representatives of the private sector, civil society and academia, who participated as observers.
The treaty covers the use of AI systems in the public sector – including companies acting on its behalf - and in the private sector. The convention offers parties two ways of complying with its principles and obligations when regulating the private sector: parties may opt to be directly obliged by the relevant convention provisions or, as an alternative, take other measures to comply with the treaty's provisions while fully respecting their international obligations regarding human rights, democracy and the rule of law. This approach is necessary because of the differences in legal systems around the world.
The convention establishes transparency and oversight requirements tailored to specific contexts and risks, including identifying content generated by AI systems. Parties will have to adopt measures to identify, assess, prevent, and mitigate possible risks and assess the need for a moratorium, a ban or other appropriate measures concerning uses of AI systems where their risks may be incompatible with human rights standards.
They will also have to ensure accountability and responsibility for adverse impacts and that AI systems respect equality, including gender equality, the prohibition of discrimination, and privacy rights. Moreover, parties to the treaty will have to ensure the availability of legal remedies for victims of human rights violations related to the use of AI systems and procedural safeguards, including notifying any persons interacting with AI systems that they are interacting with such systems.
As regards the risks for democracy, the treaty requires parties to adopt measures to ensure that AI systems are not used to undermine democratic institutions and processes, including the principle of separation of powers, respect for judicial independence and access to justice.
Parties to the convention will not be required to apply the treaty's provisions to activities related to the protection of national security interests but will be obliged to ensure that these activities respect international law and democratic institutions and processes. The convention will not apply to national defence matters nor to research and development activities, except when the testing of AI systems may have the potential to interfere with human rights, democracy or the rule of law.
In order to ensure its effective implementation, the convention establishes a follow-up mechanism in the form of a Conference of the Parties.
Finally, the convention requires that each party establishes an independent oversight mechanism to oversee compliance with the convention, and raises awareness, stimulates an informed public debate, and carries out multistakeholder consultations on how AI technology should be used. The framework convention will be opened for signature in Vilnius (Lithuania) on 5 September on the occasion of a conference of Ministers of Justice.
PROPOSED AMENDMENTS -
Thórhildur Sunna ÆVARSDÓTTIR
Pirate Party, Iceland Socialists, Democrats and Greens Group
Areas for improvement in the Draft Framework Convention and proposed amendments
Artificial Intelligence: Ensuring respect for democracy, human rights and the rule of law
"On 20 March 2024, the Committee of Ministers transmitted the draft Framework Convention on artificial intelligence, human rights, democracy and the rule of law to the Parliamentary Assembly and invited the latter to give an opinion.
"The Assembly is due to adopt such an Opinion during its next plenary Session (15-19 April 2024).
"Once the Assembly’s opinion has been received, the draft Framework Convention will be examined by the Ministers’ Deputies and transmitted to the Committee of Ministers for adoption at its Ministerial Session on 17 May 2024.
WHAT DOES THE ASSEMBLY CALL FOR?
"The Assembly strongly believes that there is a need to create a cross-cutting regulatory framework for AI, with specific principles based on the protection of human rights, democracy and rule of law.
"PACE endorsed a set of basic ethical principles that should be respected when developing and implementing AI applications.
"These principles, which are further elaborated in a common appendix to the reports, are transparency, justice and fairness, human responsibility for decisions, safety and security and privacy and data protection.
"However, the Assembly considers that self-regulatory ethical principles and policies voluntarily introduced by private actors are not adequate and sufficient tools to regulate AI.
"In each of the situations examined in its reports, the Assembly concludes that legal regulation will be necessary in order to avoid or minimise the potential risks to democracy, human rights and the rule of law.
"The various resolutions propose sets of focused measures that national authorities should implement in order to achieve this goal.
EPDS Provides Assessment of Pending Council of AI Treaty - Expresses Concerns about Scope, Clarity, and Lack of Clear Prohibitions (March 11, 2024)
URGENT ACTION -Center for AI and Digital Policy Seeks Support for Citizens Declaration on the Council of Europe AI Treaty Negotiation. (January 23, 2024)
Reference: "EU prepares to push back on private sector carve-out from international AI treaty," Euractiv 10 January 2024
(Sept. 5, 2023) - In advance of a drafting session for the Committee on AI of the Council of Europe, civil society organizations have urged member states to avoid references to "national security" that could weaken the first global treaty on AI. The mission of the Council of Europe is to promote democratic institutions, the rule of law, and fundamental rights. But civil society groups warn that proposed exemptions in the draft AI Treaty for national security could aid authoritarian governments. They have recommended either (1) that national security not be mentioned at all, or (2) be referred to only as a legitimate ground for restrictions of the rights outlined in the AI Treaty that must be clearly established by law and be necessary and proportionate in a democratic society.
[Statement of the Conference of NGOs of the Council of Europe.]
Committee on Artificial Intelligence (CAI), Consolidated Working Draft of the Framework Convention on Artificial Intelligence, Human Rights, Democracy, and the Rule of Law (7 July 2023) [published by the Chair and the Secretariat of the CAI]
Following Third Plenary Session, Committee on AI releases List of Decisions and Zero Draft.
The Committee noted that the Zero Draft is "a document prepared by the Chair and the Secretariat and does not reflect the final outcome of negotiations in the Committee."
European Council - New EU priorities for a reinforced strategic partnership with the Council of Europe (CoE) on human rights, democracy and the rule of law (Jan. 30, 2023)
"Today, the Council of the European Union, the institution gathering the ministers of EU Member States, adopted the new priorities that will guide the cooperation between the EU and the CoE in the next two years. . . . Acceding to the European Convention on Human Rights will remain the EU core policy objective at the CoE. . . . Our cooperation agenda for the next two years also recognises the emergence of new topics in relation with human rights, such as advanced digital technologies, artificial intelligence, climate change and environmental protection. . . . the EU and the CoE stand united and determined to further build on each other’s strengths and competences to uphold and promote human rights, democracy and the rule of law in Europe and beyond." [MORE]
CAIDP Statement Regarding the Decision to Exclude Civil Society Organizations from the Drafting Group of the Council of Europe Committee on AI (Jan. 17, 2023)
"We are concerned about the recent decision to exclude civil society organizations, including CAIDP, from the drafting group for the COE AI Treaty. We have spent more than two years contributing actively and constructively to the work of the Council of Europe on Artificial Intelligence. We remain committed to the mandate of the Council of Europe Committee on AI. We will continue to express our views on the draft text. And we look forward to the adoption of a global treaty for AI that protects fundamental rights, democratic values, and the rule of law.”
- Center for AI and Digital Policy
- AlgorithmWatch
- Global Partners Digital
- Fair Trials
In a letter addressed to Secretariat of the Committee on AI of the Council of Europe, civil society organizations have asked to observe the upcoming sessions of the Drafting Committee for the Council of Europe Convention on AI. At the most recent plenary session in Strasbourg, civil society organizations were denied the opportunity to actively participate in the drafting committee. Excerpts from the civil society letter:
We have created this informational page to provide access to the documents concerning the development of Council of Europe Treaty on AI, the relevant work of CAIDP and others, and to chart the important milestones as the proposal moves forward.
In December 2021, the Council of Europe’s Ad Hoc Committee on Artificial Intelligence (CAHAI) published “Possible elements of a legal framework on artificial intelligence based on the Council of Europe’s standards on human rights, democracy and the rule of law.” The Possible Elements Report established the need for an international, legally binding treaty focused on AI. The Report laid the groundwork for the successive Committee on Artificial Intelligence (CAI). The CAI will build on the CAHAI’s recommendations and elaborate an “appropriate legal instrument”, likely to lead to a transversal legally binding document by 2023.
The Council is a leader in the realm of international legal instruments and human rights. All Council of Europe member states have ratified the European Convention on Human Rights, a treaty designed to protect human rights, democracy and the rule of law. And Article 8 of that Convention has done much to shape modern privacy law. There are 46 member states, including the 27 members of the European Union. COE Conventions are also open for ratification by non-member state. The original COE Convention on Privacy (Convention 108) was ratified by 56 countries.
In 2020, the Parliament Assembly of the Council of Europe adopted a resolution on the Need for Democratic Governance of Artificial Intelligence. The Assembly called for “strong and swift action” by the Council of Europe. The parliamentarians warned that “soft-law instruments and self-regulation have proven so far not sufficient in addressing these challenges and in protecting human rights, democracy and rule of law.”
“AI can bring about economic and social progress, and improve government transparency and democratic participation, but it can also be used to disrupt democracy through interference in electoral processes, or manipulating public opinion,” the parliamentarians stressed, adopting unanimously a resolution based on the report of Deborah Bergamini (Italy, EPP/CD). She warned that filtering information and mass surveillance, enabled by AI, “risk undermining civil rights and political freedoms and the emergence of digital authoritarianism.”
The Council of Europe resolution also follows extensive work by the COE Ad Hoc Committee on Artificial Intelligence (CAHAI). In September 2020 the COE Committee of Ministers approved the CAHAI progress report, which concluded that the “Council of Europe has a crucial role to play today to ensure that AI applications are in line with human rights protections.” The Ministers asked the CAHAI to draft a feasibility study on a legal instrument that could “regulate the design, development and application of AI that have a significant impact on human rights, democracy and the rule of law.” The COE Ministers also proposed that the CAHAI should examine “human rights impact assessments” and “certification of algorithms and AI systems.”
The Third Plenary Meeting of the Committee on Artificial Intelligence took place in Strasbourg France, 11 - 13 January 2023
The Fourth Plenary Meeting of the Committee on Artificial Intelligence took place 1-3 February, 2023
The Fifth Plenary Meeting of the Committee on Artificial Intelligence will take place 19-21 April, 2023
Provisional Calendar of Meetings (March 2022)
132nd Session of the Committee of Ministers (20 May 2022)
Turin, Italy
The Council is now faced with one of the most crucial issues in today's society, namely the risks posed to human rights, democracy and the rule of law by the development and use of the artificial intelligence (AI). AI is an opportunity and a challenge for our societies. Building on the work carried out by the Ad Hoc Committee on Artificial Intelligence (CAHAI), we will hopefully decide in May the tangible actions that the Council of Europe will undertake to help build a future in which the enormous potential of artificial intelligence will be at the service of human needs. [Document]
"Major milestone with the launch of first international treaty on AI. Council of Europe treaty is the the first-ever international, legally binding instrument towards ensuring AI systems are aligned with human rights, democracy and the rule of law. ANY state can sign this treaty.
"I am proud of being part of the drafting discussions for many years along with my colleagues Marc Rotenberg Karine Caunes , and what Center for AI and Digital Policy team contributed. We worked hard along with many amazing colleagues in civil society and state delegations. "
- Merve Hikcok, CAIDP President
The AI Treaty is historic,” Marc Rotenberg, executive director of the Center for AI and Digital Policy, told Nextgov/FCW. “There is now consensus on the need to safeguard fundamental rights, democratic values and the rule of law in the development and oversight of AI systems.”
Rotenberg said that the CAIDP welcomes the endorsement of the Framework by U.S. signatories, though the document will still need to be ratified by the U.S. Senate.
“As Council of Europe Conventions are open to both member and non-member states, this convention will likely become the first global treaty for the governance of AI,” he said. “CAIDP is urging countries to endorse the Council of Europe AI Treaty. This is critical to ensure safe, secure and trustworthy AI.”
"Finally, we have a treaty based on the rule of law, human rights, and democratic values that opens the door to a common framework for managing AI technology! The COE AI Treaty is unique in its combination of adaptability and legal force. It stands as an example to other continents for regional governance of AI technology that will enable all citizens to build lives of value and dignity in tandem with AI."
- Professor Emma Ruttkamp-Bloem
"For its 75th anniversary, the Council of Europe offers to all of us the first-ever, ground-breaking Convention, bringing together Artificial Intelligence and the three fundamental pillars of Europe, human rights, democracy, and the rule of law. I strongly support this fantastic achievement. We, Europeans, should celebrate and hope that all States within the Council of Europe will sign and ratify it very quickly."
- Prof. Dr Pascal Pichonnaz
President of the European Law Institute (ELI)
"As the first legally binding international treaty on artificial intelligence, the AI Convention offers States across the globe the opportunity to commit to a common framework aligned with the values of democracy, the rule of law, and human rights. While the Convention is not a comprehensive solution, its signing and ratification will represent important steps towards upholding human rights principles in the face of rapid adoption of AI technologies."
- Dr Maria Helen Murphy
Associate Professor, Maynooth University
"I'm very happy to see this Treaty signed by member states and others. It provides a ground level of agreement on how we manage what will become the dominant technology of the future."
- Professor Stuart J. Russell
""In the era when the politics of 'mattering' permeate AI governance, the voices of those who live in the margins get more muted, while their rights get tramped on. The Council of Europe AI Treaty, is a milestone achievement to enable AI governance that centres on the rights and freedoms of underserved and underrepresented communities and groups."
- Dr Angella Ndaka
"We are at a crossroads in the development of AI, it offers a lot, but also has critical sides - as a global society we need rules for development and application. The Council of Europe AI Treaty is a milestone achievement in this respect."
- Hannes Werthner
Digital Humanism Initiative
"The Council of Europe Convention on Artificial Intelligence is a milestone achievement for the governance of AI, aiming to ensure human rights, the rule of law and democratic principles in the use of AI"
- Prof. Katja Langenbucher
"Human rights must be safeguarded, reinforced and defended in the AI machine age. The Council of Europe AI Treaty represents a significant advancement towards establishing accountable international governance of AI."
- Gry Hasselbalch, scholar and author, Co-founder DataEthics.eu
-
"The Council of Europe AI Treaty is a first step for the governance of AI at a truly world scale, a very timely achievement. I hope that with this treaty we improve the current use-based technology regulation to a problem-based regulation, limiting the harm to people and the environment, as well as controlling discrimination, disinformation and mental health issues."
- Ricardo Baeza-Yates, Director of Research, Institute for Experiential AI at Northeastern University
"The Council of Europe AI Treaty is indeed a landmark achievement in global AI governance which is worthy of support. It establishes a crucial framework for the ethical development and responsible use of AI, while safeguarding human rights, democracy and the rule of law. By promoting international collaboration and addressing critical issues like transparency, accountability and data privacy, the Treaty paves the way for responsible and trustworthy AI systems that can be beneficial to society and subsequently reduce associated risks. This initiative represents a significant step toward harmonising AI standards globally."
- Dr Kutoma Wakunuma – Associate Professor, De Montfort University
"The CoE AI Treaty is an essential step towards a global convergence on AI regulation. It is a crucial moment that will positively impact the future of our rule of law, democracy and fundamental rights in the global market"
- Dr. Gianclaudio Malgieri
Associate Professor of Law & Technology at eLaw, Leiden University (NL)
"As someone deeply committed to the responsible development and use of AI, I am thrilled to see the Council of Europe AI Treaty become a reality today. This groundbreaking treaty is a vital step in ensuring that AI aligns with the core values of human rights, democracy, and the rule of law. It sets the stage for a future where AI can be a force for good, empowering individuals and communities while protecting their dignity. I truly believe this treaty will inspire other regions to adopt similar frameworks, guiding AI development with accountability, fairness, and a shared sense of responsibility"
- Prof. Dr. Virginia Dignum
"The COE AI Treaty marks a point of no return, by showing the way in which AI should be regulated. Multilateral approach, respect for local values but at the some time a shared and very serious commitment to take human rights seriously."
- Prof. Oreste Pollicino
"The Council of Europe AI Treaty is a groundbreaking step towards the adoption and implementation of responsible AI that ensures inclusion, justice and respect of human rights for all."
- Dr. Nagla Rizk
"The convention is a great achievement. It sets the stage for the human-friendly developments of AI, supported by international collaboration. It admirably syntheses the principles of AI humanism: human rights and fundamental social values should inspire and direct any development and deployment of AI systems."
- Prof. Giovanni Sartor, European University Institute, Law Department
“September 5th marks an important milestone for developing international frameworks that protect human rights, democracy, and the rule of law throughout the AI system lifecycle. Kudos to the United States and other jurisdictions for signing the Council of Europe’s legally binding landmark AI Treaty.”
- Prof. Lee Tiedrich
"In an era defined by rapid technological innovation, it is imperative that we implement robust safeguards to protect individuals and society from potential harms that AI may pose. The COE AI Treaty not only addresses these challenges but also lays a foundation for ethical AI development that respects human dignity and promotes transparency and accountability. By fostering international cooperation and shared responsibility in the field of AI, the treaty encourages member states to collaborate in creating policies that uphold our core democratic ideals. It is a proactive step towards ensuring that AI serves as a tool for empowerment rather than oppression, reinforcing a commitment to a just and equitable digital future."
- Prof. Ingrid Schneider
“Good news coming from Strasbourg! Having an international treaty is for sure an important step for the AI landscape. However this is only the beginning of a process. We should follow the treaty implementation and be sure that it will not affect basic human rights on the one side and neither the right to development and innovation on the other side.”
- Prof. Eduardo Bertoni
Theodoros Rousopoulos, President, Parliamentart Assembly, Council of Europe
PACE President Theodoros Rousopoulos has welcomed the opening for signature of the new Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law, which he hailed as “a major step forward” and a springboard for ongoing discussion about the ramifications of AI in all our lives.
“We must be ready to use this powerful and exciting technology for the good of society, in full awareness of the possible risks, and maintaining always human control over what humans have created,” the President said, recalling that AI had been one of the priority areas for his Presidency. . . .
In an opinion adopted unanimously in April, the Assembly warmly welcomed the drafting of the convention and urged its entry into force as soon as possible – while regretting that it “does not cover to an equal extent public and private actors”.
The President pointed out that negotiations for the convention brought together not only Council of Europe member states, but other countries from around the world, including the US and Canada. “AI knows no borders. The challenges we face today are global in their scope and impact, and it is right that the principles and values which guide the Council of Europe should be shared with other regions of the world.”
Lord Holmes (UK)
Today (5 Sept) at a Council of Europe meeting the Lord Chancellor will sign an international agreement that commits signatories (including countries outside the Council of Europe) to collective action on AI development.
The new agreement has 3 over-arching principles:
🕵♂️ protecting human rights, including ensuring people’s hashtag#data is used appropriately, their hashtag#privacy is respected and they are not discriminated against
🗳 protecting hashtag#democracy by ensuring countries take steps to prevent public institutions and processes being undermined
📜 protecting the rule of law, by putting the onus on signatory countries to regulate hashtag#AI-specific risks, protect its citizens from potential harms and ensure it is used safely
The government say they "will work closely with regulators, the devolved administrations, and local authorities as the Convention is ratified to ensure it can appropriately implement its new requirements."
Great to see progress and international consensus around these important principles and a nudge towards regulation but I still believe we are moving too slowly. I urge the government to move much faster and introduce legislation for all hashtag#OurAIFutures.
Reference Documents
Planning
We specifically support the recommendations set out in the CAHAI draft, including the strong emphasis on transparency, accountability, fairness, and redress, as well as further recommendations described below. We also want to highlight the importance of creating a legally binding transversal instrument within the framework of the Council of Europe to enable AIbased systems to promote a better society where technology promotes broad social inclusion based on fundamental rights, democratic institutions, and the rule of law.
Before an AI system is introduced to a domain as a "solution," we should understand the domain from all perspectives. AI provides the ability to take a snapshot of our institutions and analyze it in ways that would not have been possible before. Therefore, the first use cases should be geared toward analysts and understanding the gaps, inequalities and possible harms that these generate.
Facial recognition used by law enforcement often requires mass surveillance of populations that is by its very definition against the rights of expression, assembly and association, protection of personal data and privacy.
There are no existing instruments that effectively regulate the design, development, and use of AI systems.
[Compilation of Replies to CAHAI Survey]
This week the Ad Hoc Committee on Artificial Intelligence (the “CAHAI”) finalized recommendations for a legal framework for AI. The Recommendation follows two years of work by the Committee, which was established by the Council of Europe in 2019. The proposal was adopted unanimously and will be sent next to the Council of Ministers for consideration.
The CAHAI explained that the legal framework should “focus on preventing and mitigating risks” from the use of AI systems and should establish “basic principles and norms governing the development, design and application of AI systems.”
This week the CAHAI published Toward Regulation of AI Systems and convened a panel to discuss Democratic Governance of AI. The CAHAI report explored global perspectives on the development of AI legal frameworks, and highlighted recent developments in Israel, Mexico, and Japan. The report emphasized that the COE has “a crucial role to play to ensure that Artificial Intelligence (AI) complies with the Organisation’s standards on human rights, democracy and the rule of law.”
Parliamentarians with both the Council of Europe and the European Union have now made clear the need to adopt legislation for the democratic governance of Artificial Intelligence.
The CAHAI fulfilled its mandate (2019-2021) and has been succeeded by the
Committee on Artificial Intelligence (CAI)
The Committee examined the feasibility and potential elements on the basis of broad multi-stakeholder consultations, of a legal framework for the development, design and application of artificial intelligence, based on Council of Europe’s standards on human rights, democracy and the rule of law.
Main Tasks
Under the authority of the Committee of Ministers, the CAHAI:
When fulfilling this task, the Ad hoc Committee was instructed to:
Resources
CAHAI, Possible elements of a legal framework on artificial intelligence, based on the Council of Europe’s standards on human rights, democracy and the rule of law (16 February 2022) (The Final Report of the CAHAI)