Related skills
aws sql nosql python airflowπ Description
- Shape and maintain scalable real-time data pipelines and infra
- Integrate data sources and ensure seamless real-time data flow
- Build fault-tolerant, highly available data ingestion processes
- Monitor and improve pipeline performance for low latency and high throughput
- Collaborate with cross-functional teams to align data infrastructure with business goals
π― Requirements
- Hands-on experience building real-time data pipelines
- Distributed streaming: Kafka, Spark Streaming, Flink
- Cloud platforms: AWS, GCP, or Azure
- Programming in Python, Java, or Scala
- SQL/NoSQL and data modelling
- Orchestration with Airflow and Kubernetes
π Benefits
- Private Health Care (Bupa)
- Hybrid Working (3 days in office)
- Travel Insurance
- Competitive Base Salary
- Company Bonus Scheme
- Market-Leading Training Programme
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!