The Data Processing teams enable Spotify to solve sophisticated and critical data engineering problems by providing a platform and tooling for the production, management and consumption of high-quality data. We are an amplifier for efficiency, quality, and innovation across Spotify.
We are looking for a backend/data engineer to help us increase efficiency, optionality and flexibility for data practitioners through scalable, portable and reliable data processing platforms, all while maintaining our global cloud cost efficiency.
What You'll Do
You’ll collaborate with product and engineering to build and support the infrastructure that empowers Spotify teams to process data to tackle critical business needs
Increase developer efficiency by building innovative tools that reduce overhead of working with data pipelines, help increase platform reliability, and are cost-efficient
Work with engineers with deep expertise in data and collaborate closely with squads in Spotify to drive improvements in the data processing ecosystem through support, best-practices and standards
Help scales the new platform to reach targets that ensure the painless and flawless migration of data pipelines from all across the company to the new stack
You love working in an environment where you constantly experiment and iterate quickly and believe data is the most powerful tool for informed decision-making Who You Are
You are proficient in backend development using Java
You are comfortable working with big data using SQL and data analytics platforms such as BigQuery
You have experience with one or more higher-level JVM-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc.
DevOps is part of your day-to-day work and you are used to working with cloud-based infrastructure and services, containerised applications
You have some experience working with Kubernetes and are familiar with its basic concepts
You have experience working with data engineering pipelines in Scala and/or Python
Quality is important to you and you know what it means to ship high-quality code
You appreciate agile software processes, and sound engineering practices like continuous delivery, defensive programming, and automated testing
You love working in an environment where you experiment and iterate quickly. You are comfortable with ambiguity, enjoy working on open-ended problems, and believe data is the most powerful tool for informed decision-making! Where You'll Be
For this role you will be based in London, UK
