AI risk prediction tools in psychiatry can reinforce systemic bias

MedicalXpress | Apr 07, 2026

A first-of-its-kind study led by researchers at the Centre for Addiction and Mental Health (CAMH) has found that artificial intelligence (AI) models used to predict aggressive incidents in acute psychiatric care can reinforce and amplify existing social and structural inequities by overestimating the likelihood of aggression among already marginalized groups. The findings, published in npj Mental Health Research, underscore the importance of careful evaluation to ensure AI tools don't perpetuate harm in clinical settings but promote more equitable care.