As we train machines to think for themselves, we might transfer to them our own gender biases. 1.ere is a big chance for this to happen as a huge amount of our data is still biased against women. For example, it has been discovered that in some career platforms, highly-paid jobs were displayed less frequently for women than for men
In a study conducted in 2017 by computer science professor Vicente Ordóñez of the University of Virginia, they discovered that the image-recognition software they were training were showing signs of sexism.
Important Points from Ordóñez’s study
- The software showed a predictable gender bias. For example, when showed a photo of a kitchen the software associated it with women, while photos showing coaching and shooting activities were associated to men.
- When asked to complete statements such as “Man is to computer programmer as woman is to X“, the AI would reply, “homemaker”.
While the researchers have been able to correct the bias, it required a researcher who was conscious with the results of his study. “It requires a researcher to be looking for bias in the first place, and to specify what he or she wants to correct.”
Why it matters
What can happen if an AI developer makes no such effort to find those biases? What other biases might be embedded in the training data being used for AI which remains undiscovered until now? How might such biases lead AI, especially those with human-level intelligence, act towards humans?