Related skills
terraform cloudformation python airflow delta lakeπ Description
- Define architecture and long-term data pipelines strategy at scale.
- Design and implement data pipelines, storage and export at scale.
- Drive integrations with third-party tools and standardize future work.
- Own infrastructure as code with Terraform and evolve cloud data infra.
- Architect orchestration for near-real-time and batch processing; ensure reliability.
- Lead data export pipelines for diverse customer needs.
π― Requirements
- Deep expertise building and scaling data pipelines; end-to-end ownership.
- AI-driven developer focusing on AI-first workflows.
- Expert Python engineer for reliable, maintainable, scalable systems.
- Experience designing/leading large-scale API integrations; robust integrations.
- Fluent in infrastructure as code (Terraform/CloudFormation) and infra as product.
- Production experience with workflow orchestration tools (Prefect, Airflow, Dagster).
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!