Related skills
sql python scala hadoop spark📋 Description
- Design, construct, install, test and maintain scalable data pipelines.
- Build APIs to integrate data sources and support volume growth.
- Collaborate with analytics teams to improve data models for BI.
- Improve data accessibility and enable data-driven decisions.
- Develop data set processes for modeling, mining and production.
- Research opportunities for data acquisition and new uses for existing data.
- Integrate new data management technologies into existing tools.
- Create custom software components and analytics applications.
- Install and maintain disaster recovery procedures.
- Provide senior technical consulting to peer data engineers.
🎯 Requirements
- Bachelor's degree in CS, Engineering, or related field, or equivalent.
- 5-8 years of experience as a Senior Data Engineer or similar.
- Experience with big data tools: Python, Hadoop, Spark, PySpark, Scala.
- Expert SQL skills for data manipulation (DML) and validation (DB2).
- Experience with data pipeline and workflow management tools.
- Experience with Python, Java, and Go for scripting.
- Strong problem solving and analytical skills.
- Excellent verbal communication skills.
- Good interpersonal skills.
- Ability to provide technical leadership for the team.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!