Unpopular opinion: I thought human review of algorithms was just a feel good story until I saw it actually fix a wrongful denial | Algorithmic Fairness Debate - Free To Speak
Unpopular opinion: I thought human review of algorithms was just a feel good story until I saw it actually fix a wrongful denial
I used to think the push for human review of algorithmic decisions was just a nice idea that didn't really change anything. Then last month a friend told me her rental application got denied by an automated system, and she only found out because a person at the company actually looked at it. The system had flagged her for a minor credit issue from 4 years ago that was already resolved, and the human reviewer took 10 minutes to see it. That saved her from losing a $1,200 deposit on an apartment in Phoenix. I'm still skeptical about how often this happens, but it's hard to argue with a real case. Has anyone else seen a human override make a real difference in an algorithm decision?
Ten whole minutes to spot a four year old credit issue that was already fixed. Wow, our new robot overlords are really getting shown up by a person with eyes and a pulse. Guess the bar for "human review" is so low that basic reading skills now count as a triumph. Still, saving $1,200 in Phoenix is nothing to shrug at.