A complete multi stage data pipeline was developed using pyspark in databricks. Some of the advanced libraries like spark graphframes were used to develop a graph.
Like this project
0
Posted Dec 16, 2024
Project was related to multi stage data processing pipeline using Medallion Architecture