Human-in-the-loop means a human actively participates in the AI workflow before a decision or action is completed. The human may label data, approve an agent action, resolve ambiguity, review a high-risk output, or choose between candidate changes.
This pattern is useful when judgment, risk, or accountability requires human decision-making. In evaluation systems, human-in-the-loop workflows often create ground truth and calibrate automated judges.