The Bottom Line
- Regulated Market Access: Tech companies must secure official approval to sell AI tools to the Spanish judiciary, creating a controlled market for platforms that meet stringent security and ethical standards.
- Human Oversight is Non-Negotiable: For businesses in litigation, judicial decisions will remain firmly under human control. AI’s role is strictly limited to support tasks like research and drafting, ensuring judges retain ultimate responsibility.
- Clear Red Lines on Risk: High-risk AI applications, such as profiling individuals, predicting behavior, or automated risk assessment, are explicitly banned, mitigating legal and ethical risks from algorithmic bias in judgments.
The Details
Spain’s General Council of the Judiciary (CGPJ) has issued a landmark instruction, creating a formal framework for the use of artificial intelligence by judges and magistrates. This move aims to standardize the adoption of AI in the justice system, ensuring it aligns with both Spanish and broader EU regulations, including the recent EU AI Act. The instruction provides a clear set of principles designed to balance the potential efficiencies of AI with the non-negotiable tenets of judicial independence, confidentiality, and the protection of fundamental rights. It’s a proactive step to harness technology while building safeguards against its potential pitfalls.
The cornerstone of the new rules is the principle of effective human control. The guidance is unequivocal: AI is an assistant, not a substitute for a judge. AI systems cannot operate autonomously to make judicial decisions, evaluate evidence, or interpret the law. To enforce this, judges are only permitted to use AI applications that have been officially provided by justice administrations and approved by the CGPJ. This creates a walled garden for legal tech, ensuring that any tool used in the judicial process has been thoroughly vetted for security, accuracy, and fairness.
The instruction provides a clear list of permitted and prohibited uses. Judges can leverage approved AI for tasks like legal research, organizing case files, and creating internal drafts or summaries. However, even when using AI to generate a draft of a ruling, the judge must conduct a “complete and critical personal review” and remains exclusively responsible for the final text. The rules explicitly forbid using AI for profiling individuals, processing specially protected personal data, or in any way that could compromise judicial independence. This clear demarcation establishes AI as a tool for efficiency, not an automated decision-maker.
Source
Consejo General del Poder Judicial
