Jump to content

Algorithmic Impact Assessment

From Justice Definitions

What is an Algorithmic Impact Assessment?

An Algorithmic Impact Assessment (AIA) is a governance process in which the developer or deployer of an algorithmic or automated decision-making system attempts to anticipate, document, and mitigate the system's potential harms before it is put into use, and often to report or publish those findings. It is consciously modelled on the impact-assessment tradition that began with environmental impact statements under the U.S. National Environmental Policy Act, and later extended to privacy (Privacy Impact Assessments), data protection (Data Protection Impact Assessments) and human rights (Human Rights Impact Assessments).[1]

Academic framings of AIA concur on three elements:

  1. Anticipation: Meaning the surfacing of likely harms before deployment rather than after;
  2. Documentation: The producing of a durable, generally public record of the system's design, data, and risks; and
  3. Accountability: By creating a forum (a regulator, the public, an internal review body) that can act on the findings.[2]

The aim of AIA is doing for algorithms what an environmental impact statement does for physical infrastructure projects. They can help agencies and the public determine whether these systems promote fairness, justice, and due process or whether they infringe on those values. For example, United States’ National Environmental Protection Act mandates that federal agencies evaluate a proposed action’s impact on the “quality of the human environment” through an Environmental Impact Statement (EIS).[3]

It is important to note that an AIA is a process, it is only as good as the accountability forum attached to it. It is a purely internal checklist with no external audience or enforcement teeth functions very differently from one tied to procurement approval, litigation, or public disclosure.[1]

Official Definition of 'Algorithmic Impact Assessment'

There is no single, universally accepted legal definition of "Algorithmic Impact Assessment", as of yet. The term is used loosely to cover at least three distinct legal instruments:

  1. a mandatory pre-deployment risk questionnaire;
  2. a fundamental-rights-focused assessment tied to a specific regulatory trigger; and
  3. a bias-audit obligation attached to a narrow use-case.

'Algorithmic Impact Assessment' as defined in legislation(s)

India

As of mid-2026, no Indian statute defines or mandates an "Algorithmic Impact Assessment." However, MeitY's AI Governance Guidelines recommend algorithmic auditing and risk-based governance but are these guidelines are non-binding, expressly favouring a 'distributed', sector-by-sector, non-statutory approach that leans on existing regulators, such as RBI, SEBI, IRDAI, etc. rather than a horizontal impact-assessment mandate.[4]

Canada

In Canada, the 'Directive on Automated Decision-Making'[5], issued by the Treasury Board of Canada Secretariat has been in force since 2019 and was most recently updated in 2023. Appendix A of the Directive defines the Algorithmic Impact Assessment as "a framework to help institutions better understand and reduce the risks associated with automated decision systems and to provide the appropriate governance, oversight and reporting/audit requirements that best match the type of system being designed".

European Union

In the Artificial Intelligence Act (Regulation (EU) 2024/1689),[6] the phrase "Algorithmic Impact Assessment" is not explicitly used. Instead, it creates a Fundamental Rights Impact Assessment (FRIA) under Article 27. Under the Article, FRIA functionally performs as an assessment of the impact on fundamental rights that the use of such system may produce.[7]

United States - New York

The New York City Local Law 144 of 2021[8] requires a narrower, audit-style instrument that acts as an independent bias audit of any Automated Employment Decision Tool (AEDT) before use, plus public disclosure of the audit summary and candidate notice. It illustrates how "AIA-adjacent" obligations get legislated piecemeal, by sector and by harm-type, rather than having a general-purpose instrument that would operate as a 'one-size-fits-all' audit, as seen in common-law jurisdictions.

'Algorithmic Impact Assessment' as defined in international instrument(s)

OECD

The OECD published the Recommendation of the Council on Artificial Intelligence[9] that establishes five values-based principles:

  1. Inclusive growth and well-being;
  2. Human-centred values and fairness;
  3. Transparency and explainability;
  4. Robustness, security and safety; and
  5. Accountability

These principles are to be routinely invoked as the normative basis for impact-assessment obligations, though the Recommendation itself does not mandate an AIA. The implementation of these principles would act sort of as a proxy-AIA.

That being said, the OECD separately maintains a practical Algorithmic Impact Assessment tool, that is a questionnaire designed to help policymakers and other officials assess and mitigate the risks associated with deploying an automated decision system.[10] This questionnaire was published by the Treasury Board of Canada Secretariat and is heavily inspired by the definitions they have followed in their existing framework, some of which have been cited above.

UNESCO

UNESCO published their 'Recommendation on the Ethics of Artificial Intelligence (2021).[11] It sets out ten principles (proportionality and do-no-harm, safety and security, fairness and non-discrimination, privacy; human oversight, transparency, accountability, awareness, multi-stakeholder governance, among others) that member states are urged to translate into domestic impact-assessment and audit mechanisms. The implementation of these ten principles would lead to the de facto execution of an AIA-like mechanism within the procedural limits of each member-states' domestic legislation.

'Algorithmic Impact Assessment' as defined in Official Government Document(s)

NITI Aayog

NITI Aayog is a public policy think-tank that released the 'Approach Document for India Part 1 – Principles for Responsible AI'.[12] It frames accountability, safety, privacy, transparency, and equality/non-discrimination as the operative principles India expects to underlie any future assessment mechanism. While a mandate for an AIA was not explicitly mentioned, the embodiment of these principles would lead to the integration of an AIA-like system.

MeitY

The Ministry of Electronics and Information Technology of India released the AI Governance Guidelines (2025)[13] and its accompanying Sub-Committee Report on AI Governance Guidelines Development.[14] It recommends 'algorithmic auditing', which is an AI incident database, and risk-tiered obligations, while explicitly declining to legislate a horizontal, EU-style ex-ante assessment mandate at this stage.

  1. 1.0 1.1 Selbst, Andrew D., An Institutional View Of Algorithmic Impact Assessments (June 15, 2021). 35 Harvard Journal of Law & Technology 117 (2021), UCLA School of Law, Public Law Research Paper No. 21-25 https://jolt.law.harvard.edu/assets/articlePDFs/v35/Selbst-An-Institutional-View-of-Algorithmic-Impact-Assessments.pdf
  2. Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. 2021. Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT '21). Association for Computing Machinery, New York, NY, USA, 735–746. https://doi.org/10.1145/3442188.3445935
  3. Reisman, Dillon, Jason Schultz, Crawford Kate, and Whittaker Meredith. “Algorithmic Impact Assessments Report: A Practical Framework for Public Agency Accountability.” AI Now Institute, April 9, 2018. https://ainowinstitute.org/publications/algorithmic-impact-assessments-report-2
  4. Ministry of Electronics and Information Technology (India), Report on AI Governance Guidelines Development https://indiaai.s3.ap-south-1.amazonaws.com/docs/subcommittee-report-dec26.pdf
  5. Treasury Board of Canada Secretariat, Directive on Automated Decision-Making (Government of Canada, 1 April 2019) https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592
  6. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act) [2024] OJ L 2024/1689. https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng
  7. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) [2024] OJ L 2024/1689, art 27 https://artificialintelligenceact.eu/article/27/
  8. New York City, Local Law No. 144 (2021), NYC Admin Code §§ 20-870 to 20-871 https://www.nyc.gov/site/dca/about/automated-employment-decision-tools.page
  9. Recommendation of the Council on Artificial Intelligence OECD/LEGAL/0449 https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449 Source: Compendium of Legal Instruments of the OECD https://legalinstruments.oecd.org
  10. The OECD.AI Policy Navigator: Algorithmic Impact Assessment https://oecd.ai/en/dashboards/policy-initiatives/algorithmic-impact-assessment-3711
  11. UNESCO, Recommendation on the Ethics of Artificial Intelligence [adopted 23 November 2021, 41st session of the General Conference] SHS/BIO/PI/2021/1. https://www.unesco.org/en/articles/recommendation-ethics-artificial-intelligence
  12. NITI Aayog, Approach Document for India, Part 1 — Principles for Responsible AI (Government of India, February 2021) https://www.niti.gov.in/sites/default/files/2021-02/Responsible-AI-22022021.pdf
  13. Ministry of Electronics and Information Technology (India), India AI Governance Guidelines: Enabling Safe and Trusted AI Innovation (Government of India, November 2025) https://www.niti.gov.in/sites/default/files/2021-02/Responsible-AI-22022021.pdf
  14. Ministry of Electronics and Information Technology (India), Report on AI Governance Guidelines Development https://indiaai.s3.ap-south-1.amazonaws.com/docs/subcommittee-report-dec26.pdf
Cookies help us deliver our services. By using our services, you agree to our use of cookies.