Embark on an exciting journey into the realm of software product development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🌍🔥
Job Description Lead the design, development, and implementation of scalable data engineering solutions on the Azure platform.Architect and manage enterprise data platforms using Azure Data Lake (ADLS Gen2) and Microsoft Fabric (Lakehouse, Data Factory, Synapse, Power BI).Design and optimize ETL/ELT pipelines for structured and unstructured data using Azure-native tools.Build and maintain data ingestion, transformation, and orchestration pipelines using Azure Data Factory / Fabric Data Pipelines.Ensure data quality, security, governance, and compliance across data platforms.Collaborate with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets.Lead and mentor junior data engineers, providing technical guidance and best practices.Optimize performance, cost, and scalability of data workflows and storage solutions.Implement CI/CD pipelines and follow DataOps best practices for deployment and monitoring.Troubleshoot production issues and drive continuous improvement across data systems. Required Skills & Qualifications 10+ Years of Experience in IT Industry6+ years of experience in Data Engineering, with strong expertise in Azure Data Platform.Hands-on experience with Azure Data Lake (ADLS Gen2) and Microsoft Fabric.Strong proficiency in SQL and Python for data processing and transformation.Experience with Azure Data Factory, Fabric Lakehouse, Synapse, and Power BI.Solid understanding of data warehousing concepts, data modeling, and big data processing.Experience implementing data security, access control, and governance in Azure.Familiarity with CI/CD, DevOps, and version control (Git).Excellent communication and leadership skills with experience leading technical teams. Good to Have Azure certifications (Azure Data Engineer Associate, Fabric certifications).Experience with real-time data processing (Event Hub, Stream Analytics).Exposure to cloud cost optimization and performance tuning. Additional Information Regards
Rajan Paul(Linkedin Profile)
Talent Acquisition
3Pillar Global
