... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality checks
a month ago
... are seeking an experienced Data Engineer to design and ... maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, ... , SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ...
26 days ago