What is an AI Bias Audit?

Definition

A bias audit is an independent review focused on whether an automated employment tool disadvantages people in protected groups. New York City Local Law 144 is the flagship example and expects annual, independent testing with public summary results for covered tools.

See also our AI compliance glossary for short definitions of common terms.

Which regulations require this

• NYC Local Law 144 (Automated Employment Decision Tools)

  Requires employers using automated employment decision tools in NYC to conduct annual independent bias audits and not...

  NYCAI-specificHighIn effect

Which states reference this obligation

What you should do next

• Confirm whether the tool is in scope for municipal or state audit rules.
• Hire a qualified independent party using a method your counsel is comfortable defending.
• Run the review on realistic production data flows, not a cleaned demo set.
• Publish or share the required summary and keep the technical workpapers on file.
• Schedule the next audit before the prior one ages out under local law.