I just found out my old college's admissions algorithm was flagged for bias
I was talking to a friend who still works there, and she told me back in 2019 they had to scrap a whole new ranking system they'd built. It was supposed to predict student success, but after a year they found it was unfairly lowering scores for applicants from certain high schools, basically penalizing kids from less wealthy areas. They only caught it because a professor in the sociology department demanded to see the data. Now they have a totally different review process that includes a human committee looking at the algorithm's suggestions. Has anyone else seen a case where catching bias meant throwing out a whole system and starting over?