When an AI system consistently produces unfair results for certain groups of people — for example, being less accurate or less favourable for women, ethnic minorities, or older adults.
When an AI system consistently produces unfair results for certain groups of people — for example, being less accurate or less favourable for women, ethnic minorities, or older adults.
Algorithmic bias manifests in multiple forms: disparate treatment (the algorithm treats groups differently based on protected characteristics), disparate impact (a facially neutral algorithm produces disproportionate harm to protected groups), and feedback loop bias (biased outputs influence future data collection, amplifying the original bias). Root causes include dataset bias, proxy variable use, objective function misalignment, and feedback loops. The EU AI Act requires providers of high-risk systems to implement bias detection and mitigation measures. ISO/IEC 23894 provides guidance on AI risk management including bias risk.
Organisations deploying AI in hiring, lending, healthcare, or law enforcement face significant legal and reputational exposure from undetected algorithmic bias — bias audits and ongoing monitoring are becoming standard practice.
Like a hiring manager who uses 'cultural fit' as a criterion that consistently selects applicants from similar backgrounds — the criterion sounds neutral but produces discriminatory outcomes.
When an AI system consistently produces unfair results for certain groups of people — for example, being less accurate or less favourable for women, ethnic minorities, or older adults.
Algorithmic bias manifests in multiple forms: disparate treatment (the algorithm treats groups differently based on protected characteristics), disparate impact (a facially neutral algorithm produces disproportionate harm to protected groups), and feedback loop bias (biased outputs influence future data collection, amplifying the original bias). Root causes include dataset bias, proxy variable use, objective function misalignment, and feedback loops. The EU AI Act requires providers of high-risk systems to implement bias detection and mitigation measures. ISO/IEC 23894 provides guidance on AI risk management including bias risk.
Organisations deploying AI in hiring, lending, healthcare, or law enforcement face significant legal and reputational exposure from undetected algorithmic bias — bias audits and ongoing monitoring are becoming standard practice.