Related skills
sql python databricks kafka spark๐ Description
- Build Python data services and pipelines ingesting raw events and exposing APIs.
- Design idempotent pipelines with deterministic keys and clear contracts.
- Implement incremental aggregations for late-arriving data and reproducibility.
- Model relationships across machines, lines, sensors, and events for context-aware apps.
- Collaborate with platform, ML, and product teams across Israel and globally to solve data challenges.
- Design end-to-end data flows from ingestion to durable storage powering products.
๐ฏ Requirements
- 5+ years of professional software engineering, backend/distributed/data-intensive systems.
- Strong Python engineering, modular architecture, testing, observability, production-grade code.
- Strong SQL and data modeling, including schema design, indexing, event-time semantics.
- Experience building incremental and idempotent data pipelines handling duplicates and late data.
- Experience with cloud platforms (Azure, GCP, AWS) and lakehouse tech.
- Experience with Kafka, Pub/Sub, Event Hubs, or similar streaming systems.
- Proven ability to diagnose and resolve production data issues (data quality, backfills, replay).
- Strong written and verbal English and collaboration with globally distributed teams.
๐ Benefits
- Stock options
- Paid parental leave
- Flex PTO
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest โ finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!