Compared two deepfake detection tools side by side last night and one missed a fake video of a politician while the other caught it in seconds

Tbh the free one flagged it instantly but the paid tool I tested said it was real, which honestly makes me wonder how many of these viral clips people are trusting without a second thought, has anyone else run into detection tools that give totally different results for the same video?

3 comments

3 Comments

nancyjones1mo ago

Jesus, that's exactly the problem right there. Paid doesn't mean better. I tested a deepfake of a local news anchor on two different tools last week and got the exact opposite results. One said 98% real, the other said 99% fake. Makes you wonder how many of those stupid viral videos people are sharing without a single thought. These tools are basically useless if they can't agree on basic stuff.

kai_webb911mo ago

Trust me, I ran into the same mess when I was trying to fact check a political ad last month. The best thing I've learned is to use at least three different detectors and only trust it if at least two of them agree. Also, try running a frame by frame analysis yourself sometimes, the detectors miss obvious stuff like weird shadows or blurry edges around the face. Honestly, these tools are just a starting point, you gotta use your own eyes too.

jamie8041mo ago

Yeah, "useless if they can't agree on basic stuff" really hit me. I used to think these tools were pretty reliable, but hearing about the exact opposite results on the same video kinda makes me realize it's all a guessing game. Maybe it's just me, but that frame by frame approach actually seems way smarter now.