Related skills
sql python databricks airflow sparkπ Description
- Own AI system reliability: evals, observability for LLM pipelines, validation outputs.
- Architect end-to-end data foundation on Databricks (Delta Lake, Unity Catalog, Spark).
- Lead data modeling and transformation with dimensional models and semantic layers.
- Hands-on analytics: SQL, dashboards, analyses with PMs and product leaders.
- Set the bar for lab data work: design reviews, observability, cost, security; mentor engineers.
- Move concepts from prototype to production; scale with central Data/Platform teams.
π― Requirements
- 12+ years building production data systems as senior IC or tech lead.
- Production-grade AI systems: trace-based evals, LLM observability, structured outputs.
- Databricks expert: Spark (PySpark/Scala), Delta Lake, Unity Catalog, Databricks SQL.
- Strong SQL and dimensional modeling; shipped warehouse layers and semantic models.
- Production-grade Python; pipelines with Airflow, Dagster, dbt on AWS/GCP.
- Substantive analytics: turn questions into data-backed answers.
- Experience in early-stage, ambiguous environments; prototype vs long-term build.
π Benefits
- Flexible time off policies to take the time you need.
- Comprehensive medical, dental, and vision coverage.
- Health Savings Account (HSA) program and care FSA.
- 401(k) with employer matching.
- Employer-paid commuter benefit.
- Support for new parents and pet-friendly offices where applicable.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!