... ) Design, build, and optimize scalable ETL/ELT pipelines using PySpark, Databricks ... data ingestion and transformation using Python. Write, tune, and optimize PL ... , DataFrames, Spark SQL). Experience with Python frameworks (e.g., pandas, Airflow, FastAPI, or ...
14 days ago