Most improvements in machine learning has been made by increasing the data (and by using models that can generalize larger data better).

Perfect data isn’t needed as the errors will “even out”. Although now there’s the problem that most new content on the Internet is low quality AI garbage.