How to Recognize Exclusion in AI

 Illustration description: A figure of a child sits, looking up at a larger-than-life globe. In the background, there are dots that mimic stars in the sky.

Illustration description: A figure of a child sits, looking up at a larger-than-life globe. In the background, there are dots that mimic stars in the sky.

Source: Inclusive Design, Medium.com

Byline: Joyce Chou, Oscar Murillo, and Roger Ibars

Excerpt: Can artificial intelligence be racist? Well, it depends. Let’s say you’re an African-American student at a school that uses facial recognition software. The school uses it to access the building and online homework assignments. But the software’s got a problem. Its makers used only light-skinned test subjects to train its algorithms. Your skin is darker, and the software has trouble recognizing you. Sometimes you’re late to class, or can’t get your assignments on time. Your grades suffer. The result is discrimination based solely on skin color.