Related skills
aws sql s3 python scalaπ Description
- Design and build batch and streaming data pipelines for ingestion and analytics.
- Own end-to-end delivery of complex data initiatives: architecture, deployment, monitoring.
- Develop and evolve the data platform with modern cloud-native tech.
- Automate data operations: validation, quality checks, alerts, backfills, recovery.
- Optimize cost, performance, and reliability of data workloads.
- Partner with Data Science, Product, and Engineering to translate requirements into solutions.
π― Requirements
- 5+ years building production-grade data platforms and pipelines.
- Python or Scala for data processing; SQL for analytics.
- Distributed data processing with Spark; performance tuning.
- Building data solutions on AWS (EMR, Lambda, S3, etc).
- Data modeling and warehousing concepts, including partitioning.
- Monitoring, alerting, incident response, and reliability of pipelines.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!