Related skills
databricks airflow spark delta lake unity catalog📋 Description
- Design and build scalable Spark and Airflow platform primitives.
- Lead migration of Spark workloads to serverless Databricks and Delta Lake.
- Optimize compute resources to reduce costs at scale.
- Collaborate with analytics and product teams for self-serve data.
- Improve reliability and governance with Unity Catalog and Trino.
🎯 Requirements
- Extensive experience with large-scale Spark and Databricks platform infra.
- Deep expertise in data orchestration with Airflow.
- Strong lakehouse fundamentals: S3 data lakes, Delta Lake, Parquet.
- Familiarity with Trino, Pinot, or Hive Metastore.
- Own multi-team platform reliability and cost optimization.
🎁 Benefits
- Challenging, high-impact work to grow your career.
- Performance-based compensation with bonuses, equity, and 401(k) matching.
- Top-tier benefits including 100% employee health coverage and family option.
- Access to leading AI tools and ongoing AI skill-building.
- Lifestyle wallet for wellness, learning, and more.
- Employer-paid life & disability, fertility, and mental health benefits.
- Paid time off including holidays, vacation, sick leave, and parental leave.
- Catered meals, events, and comfortable workspaces.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!