Description: Key Responsibilities Build and Maintain Data Pipelines: Develop scalable data pipelines using PySpark and Spark within the Databricks environment. Implement Medallion Architecture: Design workflows using raw, trusted, and refined layers to ...
18 days ago