Design tests for GenAI features: conversational AI, agentic systems.
Develop automated tests for prompts, incl. regression tests.
Create evaluation frameworks for GenAI quality: accuracy, relevance, safety, latency.
Build and maintain test datasets and golden examples for diverse scenarios.
Implement monitoring and alerts for GenAI quality degradation.
Adversarial testing to identify failures, hallucinations, biases, risks.

🎯 Requirements

3+ years QA/test engineering, preferably AI/ML.
Strong GenAI knowledge: LLMs, prompts, AI patterns.
Experience with test automation frameworks and scripting (Python, JavaScript, Selenium, Pytest)
Knowledge of functional, integration, regression, performance, security testing.
Design test cases and evaluation criteria for non-deterministic systems.
Strong analytical and problem-solving skills with attention to detail.

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot