Related skills
aws databricks airflow spark sqs๐ Description
- Design, code and manage end-to-end data ingestion pipelines online and offline.
- Develop and maintain modern data infrastructure with best practices.
- Ensure high-scale ingestion services with availability and scalability.
- Run production by monitoring system health and data quality.
- Own data infrastructure features from design to production.
- Lead design decisions and collaborate with product teams.
๐ฏ Requirements
- 5+ years in developing code for big data infrastructure.
- Proficiency with Databricks, Spark, Airflow, Firehose, SQS.
- Experience with AWS or other cloud providers.
- Strong communication and collaboration across teams.
- Translate business needs into technical options and assess tradeoffs.
๐ Benefits
- Hybrid office model with remote work flexibility.
- Competitive perks and compensation packages.
- Career growth and internal mobility opportunities.
- Inclusive culture supporting diversity and equality.
- Team outings and regular happy hours.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest โ finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!