from Hacker News

Ask HN: How to Learn Data Engineering?

by factorymoo on 7/22/24, 2:56 AM with 2 comments

Hi, I've been a data scientist in FAANG for 10 years. I realize that I heavily rely on data engineers to ensure that I have data ready to analyze / create tables on top of.

I would like to learn how to set up my own database. Say a sensor / app is emitting data, how do I go from that raw signal (could be digital or analog) to a nice SQL style table?

My company gives my L&D budget so happy to pay for courses / classes. Ideally a course over a book given my learning style but I'm happy with any quality resource!

  • by rexreed on 7/22/24, 3:19 AM

    What level of detail are you looking for? Have you not tried just putting the sensor data into a simple SQLite database and starting there?

  • by pjacotg on 7/24/24, 6:09 PM

    You could try the Stanford database moocs [0], they're on EdX as well. This will focus more on the relational model, SQL and database fundamentals. These are the fundamentals you need to understand so you can structure your tables and design a schema.

    [0] https://online.stanford.edu/courses/soe-ydatabases0005-datab...