Related skills
java kubernetes hadoop spark spring bootAt Lalamove, we believe in the power of community. Millions of drivers and customers use our technology every day to connect with one another and move things that matter. Delivery is what we do best and we ensure it is always fast and simple. Since 2013, we have tackled the logistics industry head on to find the most innovative solutions for the world’s delivery needs. We are full steam ahead to make Lalamove synonymous with delivery and on a mission to impact as many local communities we can. We have massively scaled our efforts across Asia and now have our sights on taking our best in class technology to the rest of the world. And we are looking for talented professionals to join us in this journey!!
As a Data Platform Engineer at Lalamove, you will be joining the growing Data Platform team to develop and enhance our data platform. The data platform is the centralised portal that enables engineers and analysts across the company to ingest, process, orchestrate, analyse, and visualize the data of our company. As part of the Data Engineering function, the team will design, develop, maintain, and scale the data platform, including the data infrastructure and data services, which provides the foundation to downstream use cases such as data warehousing, reporting, machine learning, analytics, data products etc.
What you’ll do:Flink: Flink on Kubernetes, state management, Checkpoint/Savepoint, exactly-once semantics, unified batch/stream processing, Flink SQL/Table API, CEP, runtime internals, and Flink CDC for real-time incremental change data capture.
Spark: Spark on Kubernetes, Spark SQL/Streaming, Adaptive Query Execution (AQE), shuffle optimization, resource isolation, and dynamic allocation.
Hive on Tez: Tez DAG optimization, container reuse, auto-parallelism tuning, and Hive MR-to-Tez migration performance optimization.
To all candidates- Lalamove respects your privacy and is committed to protecting your personal data.
This Notice will inform you how we will use your personal data, explain your privacy rights and the protection you have by the law when you apply to join us. Please take time to read and understand this Notice. Candidate Privacy Notice: https://www.lalamove.com/en-hk/candidate-privacy-notice
Meet JobCopilot: Your Personal AI Job Hunter
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!