Major study shines spotlight on AI healthcare bias

Published in The Lancet Digital Health and NEJM AI, the ‘STANDING Together (STANdards for data Diversity, INclusivity and Generalisability)’ study involved more than 350 experts from 58 countries. STANDING Together is led by researchers at University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham.

The new recommendations aim to ensure that datasets used to train and test medical AI systems represent the full diversity of the people that the technology will be used for. This is because AI systems often work less well for people who aren’t properly represented in datasets. People who are in minority groups are particularly likely to be under-represented in datasets, so may be disproportionately affected by AI bias. 

“Data is like a mirror, providing a reflection of reality,” said chief investigator Dr Xiao Liu, Associate Professor of AI and Digital Health Technologies at the University of Birmingham. “When distorted, data can magnify societal biases. But trying to fix the data to fix the problem is like wiping the mirror to remove a stain on your shirt.