... experience Job Description:Data Pipeline Development: Design, develop, test, and deploy ... robust and scalable data pipelines using PySpark ... ADLS, databases, APIs, streaming data).Big Data Processing: Utilize PySpark to process ...
a day ago