AWS- Data Engineer - AU (Melbourne)

AWS Data Engineering Framework Specialist

Description:We are looking for a Data Engineer who is adept at building and maintainingdata engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines, ensuring they are efficient and aligned with the bank's data strategy.

Key Responsibilities:

Experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.

Proven experience in building advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.

Strong understanding of writing efficient, reliable, and maintainable code to manage data workflows.

Solid foundation in software engineering, including Object-Oriented Design (OOD) and design patterns.

Optimize data processing pipelines for performance and scalability.

Collaborate with data architects to implement best practices and improve data framework capabilities.

Assist in resolving technical challenges and provide support to the data engineering team.

Minimum Qualifications:

Bachelor’s degree in Computer Science, Engineering, or a related technical field.

3+ years of hands-on experience with AWS services, specifically EMR and Glue.

Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.

Solid understanding of SQL, data modeling, and ETL processes.

Preferred Qualifications:

Experience with version control systems and CI/CD pipelines.

Familiarity with additional AWS services and data analytics tools.