... design and maintain scalable data pipelines in Databricks. The ... to-end ownership of data workflows, from ingestion to ... in Databricks (PySpark, SQL, Delta Lake). Ingest data from databases, APIs ... , and web scraping. Implement data quality checks, validation, and ...
5 days ago