Related skills
python databricks pyspark graph neural networks graphframesπ Description
- Lead evaluation and improvement of entity resolution and linking pipelines.
- Debug new builds, identify anomalies, and recommend modeling or system-level improvements.
- Define, implement, and maintain scalable metrics, leveraging automation and LLMs.
- Partner with Engineering to optimize entity linking and ranking systems with Learning-to-Rank.
- Design methods to assess and classify entity confidence and quality across the graph.
- Act as a technical leader within the Identity org, influencing modeling standards and best practices.
π― Requirements
- Strong proficiency in Python and PySpark.
- Deep experience with classification models, Learning-to-Rank, anomaly detection, statistical modeling.
- Experience building and maintaining production-grade ML systems at scale.
- Databricks experience; graph databases (NeptuneDB, OpenCypher); GraphFrames.
- Familiarity with Knowledge Graphs and Graph Neural Networks (GNNs).
- MS/PhD in CS/DS/ML/Stats; 5+ years in graph ML.
π Benefits
- Salary: $170Kβ$205K per year (USD).
- Equity: Offers equity.
- Bonus: Offers annual bonus.
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!