This browser is not actively supported anymore. For the best passle experience, we strongly recommend you upgrade your browser.
Insights Insights
| less than a minute read

First EEOC Settlement on AI Bias in Hiring Software

A company providing software using artificial intelligence ("AI") to hire language tutors will pay $365,000 to job candidates to settle a discrimination case filed by the Equal Employment Opportunity Commission.  

The EEOC alleged that the software in question, created by iTutorGroup, used an algorithm that automatically excluded female candidates aged 55 or older, and male candidates aged 60 or older, based on date of birth. This exclusion would be a blatant violation of the Age Discrimination in Employment Act of 1967

While the issues with the iTutorgroup algorithm were clear to spot in this particular case, potential discrimination in algorithms is not always this obvious. AI relies on historical data, which can reflect historic patterns of exclusion and can therefore perpetuate biases.  Amazon learned this in 2018 when it realized that their AI hiring tool was not gender-neutral and favored male candidates.

As AI discrimination cases become more commonplace, employers should make sure they understand how AI is used in any software that they implement as part of their recruitment process.  

Amazon’s computer models were trained to vet applicants by observing patterns in resumes submitted to the company over a 10-year period. Most came from men, a reflection of male dominance across the tech industry.


desilva_manori, insights, employment, employment and labor lit, ai and blockchain, de silva_manori