Study shows AI in hiring scores higher in fairness metrics compared to humans

A new report from AI auditing platform Warden AI, The ‘State of AI Bias in Talent Acquisition 2025’, suggests that AI models may reduce, not increase, bias in hiring. This is despite concerns about accountability and fairness continuing to worry business leaders and employees alike, plus high-profile cases such as Mobley v Workday capturing headlines. Three-quarters (75%) of HR leaders cite bias as a top concern when evaluating AI tools, second only to data privacy.

As artificial intelligence continues to transform HR, with three in four HR teams now adopting AI and automation tools, a new report* suggests that AI models may reduce, not increase, bias in hiring. This is despite concerns about accountability and fairness continuing to worry business leaders and employees alike, plus high-profile cases such as Mobley v Workday capturing headlines. Three-quarters (75%) of HR leaders cite bias as a top concern when evaluating AI tools, second only to data privacy.

 Fairer and more consistent across tested demographics

The report, which analyzed “high-risk” AI systems used in talent acquisition and intelligence platforms, reveals that AI may help organizations make fairer decisions than their human counterparts. On average, most AI models audited were found to deliver outcomes that were fairer and more consistent across the demographic groups tested.

 The findings challenge the ongoing public assumption that AI is inherently less fair and counteract academic research that shows a rising incidence of bias in publicly available AI models. Warden AI’s audits evaluate how AI models perform across different demographic groups, such as male and female sexes. They assess both the overall outcomes and the model’s sensitivity to demographic attributes. In the first case, models are tested to see whether different groups receive similar outcomes, with 85% meeting industry fairness thresholds. In the second, models are tested to see whether changing attributes linked to demographics (such as names) affects the result, with 95% meeting high standards of consistency across groups.

 Some AI systems remain unfair

 Not all systems performed equally well: 15% of AI tools failed to meet fairness thresholds for all demographic groups, with performance varying by as much as 40% between vendors, underscoring the importance of carefully selecting responsible vendors to partner with. Nonetheless, the data suggests AI outperforms humans on fairness metrics, with an average fairness score of 0.94, compared to 0.67 for human-led hiring.

Notably, the data suggests female candidates experience up to 39% fairer treatment when AI is involved compared to humans. For racial minority candidates, that figure is even higher at up to 45%.

Still, HR and talent acquisition leaders remain cautious in their AI buying decisions. Only 11% of HR buyers report ignoring AI risk when assessing vendors, while 46% say that a vendor who shows a clear commitment to Responsible AI is a critical driver of success in the procurement process.

 High-profile cases are damaging AI perception

 Warden AI’s research comes at a pivotal moment, as public awareness of AI bias grows. The recent Mobley v. Workday case (a high-profile lawsuit alleging algorithmic discrimination in hiring) underscores the real-world legal, reputational, and financial risks AI bias can pose.

“Business leaders and the public rightfully are concerned about AI bias and its impacts. But this fear is causing us to lose sight of how flawed human decision-making can be and its potential ramifications for equity and equality in the workplace,” said Jeffrey Pole, CEO and co-founder of Warden AI. “As our research shows, AI isn’t automatically a better or worse solution for talent acquisition. This is a wake-up call to HR and business leaders: when used responsibly, AI doesn’t just avoid introducing bias, it can actually help counter inequalities that have long existed in the workplace.”

 Kyle Lagunas, Founder and Principal at Kyle & Co., said, “After a decade advising HR and Talent leaders on how to adopt technology responsibly, I’ve seen excitement around AI quickly give way to concern, especially around bias and fairness. But now is the time to lean in—and find real answers to the real risks we face.

“This report brings a number of interesting points together to crystallize this critical conversation. As the findings highlight, while AI bias is real, it is also measurable, manageable, and, thankfully, mitigatable.”

 

 

*Report from Warden AI, The ‘State of AI Bias in Talent Acquisition 2025’,

Read more

Latest News

Read More

Why so many smart leaders are terrible at leading people

29 July 2025

Talent Management

29 July 2025

Deepfake interviews. Synthetic faces. Tampered documents. As generative AI reshapes identity fraud, traditional screening methods are being put to the test. Giant Screening CEO Mathew...

Worklife Balance

28 July 2025

The issue isn’t just about time management; it’s about mental bandwidth. The cognitive load of managing multiple priorities can leave little room for self-care, creativity,...

Newsletter

Receive the latest HR news and strategic content

Please note, as per the GDPR Legislation, we need to ensure you are ‘Opted In’ to receive updates from ‘theHRDIRECTOR’. We will NEVER sell, rent, share or give away your data to third parties. We only use it to send information about our products and updates within the HR space To see our Privacy Policy – click here

Latest HR Jobs

Queen Mary University of London – IT Services DirectorateSalary: £54,617 to £60,901 per annum

University of Sussex – Human Resources Salary: £25,733 to £29,179. Grade 4, per annum, pro rata if part time

UCL – Chemistry Department / Faculty of Mathematical & Physical SciencesSalary: £54,172 to £63,752

University of Oxford – Department of PsychiatrySalary: £31,459 to £36,616 (discretionary range to £39,749) per annum. Grade 5

Read the latest digital issue of theHRDIRECTOR for FREE

Read the latest digital issue of theHRDIRECTOR for FREE