Related skills
databricks airflow spark delta lake unity catalog📋 Description
- Design and build scalable Spark and Airflow primitives.
- Lead migration of Spark workloads to serverless Databricks and Delta Lake.
- Optimize compute resources to reduce costs in large-scale systems.
- Collaborate with analytics and product teams for self-serve data processing.
- Improve reliability and governance with Unity Catalog and Trino.
🎯 Requirements
- Large-scale Spark and Databricks infrastructure experience.
- Data orchestration with Airflow for complex jobs.
- Lakehouse fundamentals: Delta Lake, Parquet, S3 data lakes.
- Query/serving infra: Trino, Pinot, Hive Metastore.
- Own multi-team platform reliability, cost optimization, and developer experience.
🎁 Benefits
- Challenging, high-impact work to grow your career.
- Performance-driven compensation with equity, bonuses, and 401(k) matching.
- Top-tier benefits including 100% paid health insurance for employees and 90% for dependents.
- Access to AI tools and ongoing AI skill-building.
- Lifestyle wallet for wellness and learning.
- Employer-paid life and disability insurance, fertility and mental health benefits.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!