Back Share
ChallengeInstances

Application of AI has potential to exacerbate, or ignore, established injustices; these biases may not be immediately clear in unbalanced data, nor apparent in short-term implementation evaluations

AI

"The research analytical process includes selecting the training data, cleaning the data, developing the model through steps of training, evaluating, adjusting, re-training the model.[..] The use of AI systems to uncover or predict social phenomena can be tainted by biases in the training data set on certain demographics or proxies thereof, which may lead to unfair and unjust outcomes.[...]. " (franzke, et al., 2020 p.41-44). Potential for biases and outcomes that do not respect justice arises throughout the research processes.

Sources AoIR report 3
Title Application of AI has potential to exacerbate, or ignore, established injustices; these biases may not be immediately clear in unbalanced data, nor apparent in short-term implementation evaluations