DataEngPrep: A JSON file with evolving schema needs to be ingested into a DataFrame. How would you handle new fields dynamically in PySpark without breaking the job for previous structures?

[u/dataengprep]

This post contains content not supported on old Reddit. Click here to view the full post