Related skills
sql python scala hadoop spark๐ Description
- Design, construct, install, test and maintain scalable data pipelines.
- Ensure systems meet business requirements and industry practices.
- Build high-performance algorithms, prototypes, predictive models, and PoCs.
- Research opportunities for data acquisition and new uses for existing data.
- Develop data set processes for data modeling, mining and production.
- Integrate new data management technologies and software engineering tools into existing structures.
๐ฏ Requirements
- Bachelor's degree in CS, Engineering, or related field, or equivalent.
- 5-8 years of experience as a Senior Data Engineer or similar.
- Experience with big data tools: Python, Hadoop, Spark, PySpark, Scala.
- Expert SQL skills for DML and validation (DB2).
- Experience with data pipelines and workflow management tools.
- Experience with object-oriented scripting languages: Python, Java, Go.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest โ finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!