Related skills
grpc snowflake rest kafka sparkπ Description
- Design and evolve Sword's streaming lakehouse.
- Build and operate low-latency, reliable streaming pipelines.
- Own durable workflows coordinating complex data moves.
- Shape the platform API surface for producers and consumers.
- Evaluate and integrate vendor data platforms within architecture trade-offs.
- Build AI-ready data infrastructure powering ML/AI products.
π― Requirements
- Proven experience designing/operating data platforms at scale.
- Iceberg lakehouse format; Delta/Hudi welcome.
- Strong catalog knowledge: REST/Polaris/Glue/Unity/Hive.
- Experience with Snowflake/Starburst/Databricks.
- Distributed processing: Flink preferred; Spark OK.
- Durable execution: Temporal/Restate or similar.
- Production APIs (REST/gRPC) experience.
- Kafka and event-driven architectures knowledge.
π Benefits
- Health, dental and vision insurance
- Meal allowance
- Equity shares
- Remote work allowance
- Flexible working hours
- Work from home
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!