A complete multi stage data pipeline was developed using pyspark in databricks. Some of the advanced libraries like spark graphframes were used to develop a graph.