Related skills
aws python gcp spark iceberg📋 Description
- Guide the Data Engineering team to build high-performance ETL pipelines using Spark
- Design the Internal Data Platform architecture to support medallion architecture
- Provide thought leadership on cost savings for cloud hyperscalers
- Design and build AI agents to automate development and support tasks
- Collaborate with Security and Compliance to ensure proper data permissions
- Collaborate with Data Platform and Governance teams to make data scalable and discoverable
🎯 Requirements
- 10+ years experience working on enterprise data lakes/warehouses
- 5+ years of Spark and Python experience
- 5+ years of direct hands-on experience with AWS or GCP
- Thorough AI knowledge, particularly with codegen tools and agentic frameworks
- Hive, Iceberg, Glue, or other technologies that expose big data as tables
- Familiarity with Parquet, Avro, and JSON
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!