Related skills
java sql python scala spark📋 Description
- Lead a team resolving complex Spark, AI/ML, streaming, and Lakehouse issues.
- Build AI-enabled support workflows and automations to speed resolutions.
- Leverage agentic AI, logs, and observability to accelerate triage and RCA.
- Create reusable runbooks and prompts to scale ops across teams.
- Ensure AI governance, data safety, auditability, and human-in-the-loop controls.
- Partner with Engineering and Product to drive AI-first support innovation.
🎯 Requirements
- 10+ years designing and supporting large-scale Data & AI apps with Python/Java/Scala/Spark.
- Experience with AI-enabled workflows, agentic AI, Claude, RAG, and vector databases.
- Production-scale Databricks stacks: Model Serving, Lakehouse, Delta, DLT, Lakeflow.
- AI tools for troubleshooting, RCA, observability, and workflow acceleration.
- Hands-on Spark, Spark SQL, Structured Streaming, Delta Lake, and distributed data processing.
- Leading production workloads across Big Data, Hadoop, AI/ML, Kafka, and streaming.
🎁 Benefits
- Comprehensive benefits; details per region via link.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!