Related skills
java postgres spring boot pyspark icebergπ Description
- Own the data platform end-to-end: ingestion, transformation, storage, and access
- Build batch and streaming pipelines with PySpark/EMR, Kinesis, Lambda, Step Functions
- Model the warehouse with SCD/event tables and data conventions
- Partner across teams to turn data requests into reliable pipelines, with docs
- Own security/compliance: audit logging, access control, temporary access
- Optimize query performance: routing, indexing, caching, IO in Java/Spring services
π― Requirements
- 5+ years building production data pipelines and platforms
- Deep Python (PySpark) and SQL fluency, including tuning Spark jobs
- Hands-on experience with Spark/EMR, Kinesis, and S3
- Postgres fundamentals: query optimization, indexing, replication
- Experience with Iceberg and Trino, or similar
- CI/CD and Terraform familiarity
π Benefits
- Compassionate teammates in a fun environment where success is celebrated
- Accelerated career growth in a fast-growing company
- Coaching from experienced engineering leaders
- Direct access to executives and a transparent culture
- Rare opportunity to impact an industry and millions of lives
- Medical / Dental / Vision
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!