F
19

Heard a dev say AI models need data scrubbing not just bigger datasets at a meetup last night

I was at a little tech meetup in Denver Tuesday and this one engineer was talking about how the real bottleneck for AI isn't more GPUs or larger models but cleaning up all the garbage data we feed them. He said most teams just dump raw web scrapes into training and wonder why the output is flaky. Got me thinking about how I approach my own small ML projects. Has anyone here tried running a serious data cleaning pipeline before training and seen a big difference in output quality?
3 comments

Log in to join the discussion

Log In
3 Comments
jakeb81
jakeb811mo ago
More data fixes bad data, just throw more web scrapes at it and call it a day.
3
susan_adams
Um, is bad data really that easy to fix with more data though? lol
4
king.eric
king.eric1mo ago
More data just means more garbage to clean up.
1