Is AI biased? Where bias in AI comes from and how to reduce it

A biased resume screener

A big company once built an AI tool to screen job applications, then had to drop it because it gave lower scores to women's resumes.

BIAS

AI learns from old data

That's bias. AI learns from old data, and ten years earlier that company had hired mostly men. AI doesn't mean to be unfair, it just learns the exact slant already in the data.

WHERE

It shows up in many places

You'll see bias in many places: ask AI to draw a company director and it often draws a man; ask about your own country's culture and it may answer from a foreign point of view.

HOW TO ASK

Be specific to reduce bias

To reduce it, say clearly what you want, for example a group of people of different genders, ages and regions. Or ask a follow-up: which side might this answer be leaning toward?

NOTE

Decisions about people

For decisions about people, like hiring or lending, let AI suggest, but a real person should review and take responsibility.