Warning: My friend in Tampa got flagged for a 'high-risk' loan algorithm last week because his address matched a 3-year-old police report for a different person. | Algorithmic Fairness Debate - Free To Speak
Warning: My friend in Tampa got flagged for a 'high-risk' loan algorithm last week because his address matched a 3-year-old police report for a different person.
How do we even start fixing a system that punishes people for data they can't control?
Ugh, that's so frustrating. Actually, the scary part is he's being punished for data he didn't even create. The system mixed him up with someone else entirely. That's the core problem. Fixing it means forcing these companies to actually check their data links are correct, not just blindly trusting a flawed match. It's like they built a robot to judge us but forgot to teach it how to tell people apart.
Seriously, it's a total nightmare. I had a bill go to collections once because some company mixed my file up with another Sage in the same town. Took forever to prove I wasn't her. That's exactly what @cole549 is getting at, right? The robot just sees a name and a birth year and slaps a label on you. They need to be forced to actually verify things, not just run a lazy match. It makes you feel totally powerless.