from Hacker News

Ask HN: What is your biggest problem with data?

by azianmike on 2/12/21, 4:37 PM with 2 comments

What is your biggest problem with data, whether it be querying it, storing it, manipulating it, processing it, etc.

What is that one problem, if solved, would make your job much more efficient?

  • by OneFunFellow on 2/12/21, 4:44 PM

    As someone who is not in the field but reads about it from time to time I see the same theme over and over: The formatting, consistency, and manual cleanup of data. The theme of data scientists who are "data janitors" that spend most of their time "cleaning data" is a consistent one.
  • by shankr on 2/12/21, 5:22 PM

    storing and querying it. It's huge and the engineers haven't been able to provide easy access.