Keeping a human meaningfully in the loop so they can catch mistakes, stop the AI when needed, and remain accountable for outcomes.
Keeping a human meaningfully in the loop so they can catch mistakes, stop the AI when needed, and remain accountable for outcomes.
Human oversight is a core requirement of the EU AI Act for high-risk systems (Articles 9 and 14). It encompasses three distinct mechanisms: human-in-the-loop (a human makes or approves each consequential decision), human-on-the-loop (a human monitors and can intervene in automated decisions), and human-in-command (a human can halt the entire system). The Act requires providers to design systems so that deployers can effectively monitor operation, detect anomalies, and intervene. Effective oversight requires technical affordances (explainable outputs, monitoring dashboards, override controls) and organisational capability (AI-literate staff with clear responsibilities).
Organisations deploying high-risk AI must design oversight workflows into business processes — not just add an 'override button' — ensuring that human reviewers have the information, time, and authority to exercise meaningful oversight.
Like an autopilot system in aviation: the technology can fly the plane, but pilots must understand the system's state, monitor its performance, and be ready to take control when the situation requires human judgment.
Keeping a human meaningfully in the loop so they can catch mistakes, stop the AI when needed, and remain accountable for outcomes.
Human oversight is a core requirement of the EU AI Act for high-risk systems (Articles 9 and 14). It encompasses three distinct mechanisms: human-in-the-loop (a human makes or approves each consequential decision), human-on-the-loop (a human monitors and can intervene in automated decisions), and human-in-command (a human can halt the entire system). The Act requires providers to design systems so that deployers can effectively monitor operation, detect anomalies, and intervene. Effective oversight requires technical affordances (explainable outputs, monitoring dashboards, override controls) and organisational capability (AI-literate staff with clear responsibilities).
Organisations deploying high-risk AI must design oversight workflows into business processes — not just add an 'override button' — ensuring that human reviewers have the information, time, and authority to exercise meaningful oversight.