Related skills
sql databricks pyspark delta lake unity catalog📋 Description
- Own end-to-end Databricks lakehouse architecture across AWS, Azure, or GCP.
- Design and scale batch/streaming pipelines with PySpark, Spark SQL.
- Define ingestion, governance, and performance patterns for petabyte-scale data.
- Lead Unity Catalog governance: access, lineage, and PII handling.
- Mentor engineers; lead architecture reviews and engineering practices.
- Collaborate with ML engineers to productionize models with MLflow.
🎯 Requirements
- 8+ years data engineering; 4+ years on Databricks.
- Deep expertise in Spark (PySpark, Spark SQL) and performance tuning.
- Delta Lake, Unity Catalog, Databricks Workflows, Delta Live Tables.
- Production cloud experience (AWS/Azure/GCP); networking, IAM, storage.
- Python and SQL; Scala a plus.
- CI/CD and DevOps with Git, Terraform; dbx or Asset Bundles.
🎁 Benefits
- Remote work options available.
- Visa sponsorship for eligible candidates.
- Mentorship and leadership development across the data organization.
- Work with global teams and clients.
🛃 Visa sponsorship
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!