Pyspark to process flight data dataset

My image My image

Flight dataset project

My image My image

Database set up for Spark jobs

My image My image

Initialize a Spark dev environment

My image My image

Set up a Spark dev environment

My image