from Hacker News

I am a (rookie) data engineer and I've recently been tasked with consuming data from a new system. This system is the first one we've consumed that stores its information in a NoSQL database, MongoDB to be exact.

Now at this point in time I've only been given a JSON dump of three table's we will consume, but it has been quite a tedious process of reading the JSON, trying to make sure I have all variations covered (e.g. sometimes a certain field is a string, other times it is an array of objects). I am using a Python script to read the JSON data and store it in a local SQLite database for exploration. Python would be my preferred method of doing things as we are not far from moving to Airflow.

Does anyone out there have experience consuming NoSQL data into a SQL database? Is there any easier methods or is it just a bit of elbow grease required?

Happy to add any further clarifying information as people need it.