Related skills
aws sql python databricks delta lakeπ Description
- Own end-to-end data platform architecture for ingestion, storage, and serving.
- Architect real-time streaming with AWS Kinesis and Spark.
- Lead lakehouse design and data serving layers for trusted datasets.
- Set standards for high performance SQL and Spark workloads.
- Drive platform modernization and cross team simplification.
- Mentor engineers and align with product analytics teams.
π― Requirements
- Real-time, distributed data systems with Kinesis and Spark Structured Streaming.
- Databricks on AWS (Delta Lake) and performance tuning.
- Data serving architectures and APIs with clear data contracts.
- Python and SQL proficiency for scalable data pipelines.
- Experience with lakehouse design and canonical event schemas.
- Ability to lead platform initiatives from architecture to production and reliability.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!