Related skills
aws python typescript rag langgraph📋 Description
- Design and ship an end-to-end AI evaluation framework.
- Define and instrument metrics: task completion, hallucinations, quality.
- Build evaluation datasets, test harnesses, and automated scoring.
- Architect reusable agent infrastructure: multi-turn workflows, LangGraph.
- Scale RAG pipelines and vector retrieval.
- Lead projects end-to-end with cross-functional collaboration.
🎯 Requirements
- 5+ years in professional software engineering with production AI/ML.
- Hands-on with LLM-based systems: prompts, RAG, orchestration, eval metrics.
- Proven ability to work with data and statistics in experiments.
- Production-grade Python: clean, maintainable, testable code.
- LangGraph and LangSmith for agent workflows and observability.
- AWS cloud infra with Lambdas and queues; TypeScript a plus.
🎁 Benefits
- Medical, Dental, Life/AD&D, and Disability Insurance
- Wellness Apps
- Paid Parental Leave and PTO
- Working Remotely Stipend
- One-time WFH Office Set-Up Stipend
- Retirement Plan and Financial Planning
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Engineering Jobs. Just set your
preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!