Related skills
python pandas databricks airflow kafkaπ Description
- Lead the in-house ML data platform: collect, store, transform, access.
- Architect and optimize scalable data workflows and pipelines.
- Establish best practices for data handling, storage, and processing in ML/analytics.
- Develop internal tools to automate data processes at scale.
- Collaborate with product, MLOps, and data science teams.
- Mentor and guide a team of data engineers.
π― Requirements
- 5+ years in data engineering; 2+ years in lead/senior roles.
- Expert in Python 3 and data tools (Pandas, PySpark).
- Hands-on with data storage: AWS S3, data lakes, data warehouses.
- Proficient in orchestration tools: Dagster, Airflow.
- Experience with streaming: Kafka, Spark.
- Based in Barcelona or willing to relocate to Barcelona.
π Benefits
- Continuous learning and growth opportunities.
- Make a lasting impact with a global company.
- Solve exciting challenges with mentors and peers.
- Fun, collaborative team culture.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!