Related skills
sql python tableau databricks powerbiπ Description
- Design and implement medallion architecture (Bronze/Silver/Gold) using Databricks
- Develop automated data pipelines from multiple sources to analytics-ready formats
- Create robust ETL/ELT workflows with Apache Spark for batch and streaming
- Build data quality monitoring and validation across the data/ML lifecycle
- Implement MLOps including automated model training, validation, deployment, and monitoring
- Design scalable ML inference systems for high-volume, low-latency production
π― Requirements
- 5+ years in data engineering, incl. 3+ years building production pipelines on Databricks
- Python, PySpark, Spark SQL with medallion architecture and modern data patterns
- Production ML systems: deployment, monitoring, and MLOps in cloud environments
- Data architecture expertise with scalable processing and governance frameworks
- Experience integrating with Qlik, Tableau, PowerBI, Palantir Foundry (MAVEN)
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!