Related skills
terraform aws sql python databricks📋 Description
- Design and manage scalable data platforms for real-time analytics and batch processing.
- Own full data lifecycle: ingestion, ETL, storage, and serving.
- Ingest data from streaming (Kafka, Kinesis) and batch sources; unify pipelines.
- Architect medallion-layer data models (Bronze/Silver/Gold) in Databricks.
- Automate tests, data quality checks, and CI/CD for data pipelines.
- Build AI-ready tooling and Databricks Genie chatbots to enable non-technical users.
🎯 Requirements
- 5+ years of high-volume data infrastructure experience.
- Core stack: Databricks, AWS (EMR, Kinesis/Kafka, S3), Spark, Airflow (MWAA), SQL, Python.
- AI-native mindset: daily use of LLM tools; evaluate AI-generated code.
- Experience with data quality frameworks (Great Expectations, DQX, or similar).
- Proven ability to architect data models, optimize SQL, and tune performance.
- Familiarity with IaC tools (Terraform) for provisioning; strong communicator.
🎁 Benefits
- Competitive pay and benefits.
- Medical, dental, vision, life, and disability insurance.
- 401(k) matching in the US; RRSP/DPSP in Canada.
- Employee Assistance Program (EAP) for mental wellness.
- Flexible PTO and 12 company-wide days off.
- Equipment, tools, and reimbursement for remote setup.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!