Related skills
terraform snowflake sql python databricks📋 Description
- Core Pipeline Engineering: Python + SQL; implement Bronze→Silver→Gold data models.
- Orchestration & Tuning: manage Prefect/Dagster; optimize serialization (Pydantic v2).
- IaC: Terraform to manage data warehouse schemas, permissions, and catalogs.
- API & Caching: expose data; maintain backend tiers, BFF, and Redis caching.
- On-Call & Observability: incident rotation; refine Datadog dashboards and alerts.
🎯 Requirements
- Data Eng Fluency: Python, advanced SQL, data transformations; Prefect/Dagster/Airflow.
- Warehouse & Catalog: Snowflake, Databricks, BigQuery; secure keys; performant queries.
- Automation mindset: automate repetitive fixes and data quality.
- Collaborative builder: readable code, data lineage; partner with engineers.
- Pragmatic solver: when to optimize vs simple, caching helps.
- Bonus: experience with data quality frameworks (Great Expectations or Soda).
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!