About InvoiceCloud:

InvoiceCloud is a fast-growing fintech leader recognized with 20 major awards in 2025, including USA TODAY and Boston Globe Top Workplaces, multiple SaaS Awards wins for Best Solution for Finance and FinTech, and national customer service honors from Stevie and the Business Intelligence Group. Judges also highlighted our mission to reduce digital exclusion and restore simplicity and dignity to how people pay for essential services, as well as our leadership in AI maturity and responsible innovation. It’s an award-winning, purpose-driven environment where top talent thrives. To learn more, visit InvoiceCloud.com.

Job Description – SDET (AI Platform & Quality Engineering)

Position Overview

The SDET – AI Platform ensures quality, reliability, performance, and safety of generative AI capabilities powering the InvoiceCloud platform. This role builds automated test frameworks, semantic validation tools, and continuous monitoring to support enterprise-grade AI delivery at scale. The SDET partners with Product, AI Engineering, Data Science, Platform, and Security teams to enable measurable, observable, and responsible AI outcomes.

Success in this position means improving AI correctness, reducing release risk, and accelerating developer velocity through automation, continuous validation, and shift-left testability.

Success Profile

Results Driven

Owns test strategy and automation for LLM, RAG, and AI-powered features.
Defines KPIs for accuracy, performance, safety, and observability.
Builds regression suites, benchmarking tools, and model evaluation workflows.

Takes Ownership

Ensures data governance, privacy, and responsible AI compliance.
Drives CI/CD quality automation, drift monitoring, and issue resolution.
Establishes disciplined validation routines and production readiness.

Innovative

Implements automation for prompt testing, semantic scoring, and safety checks.
Uses AI frameworks (Azure OpenAI, LangChain, Semantic Kernel, vector databases) to build reusable quality tooling.
Partners with engineering to improve testability, telemetry, and quality insights.

Customer Centric

Validates AI behaviors that improve payer and CSR experiences.
Measures business impact through accuracy, call deflection, and handle time improvement.
Advocates for safe, transparent, and trustworthy AI outcomes.

Requirements

5+ years in test automation or SDET roles in SaaS or distributed systems.
Hands-on experience validating AI/ML, NLP, or analytics-driven applications.
Strong skills in Python (preferred) and CI/CD automation.
Familiarity with Azure OpenAI, LangChain/Semantic Kernel, or vector search is a plus.
Knowledge of responsible AI practices, privacy, RBAC, and security testing.
Excellent communication and collaboration across engineering, product, and quality teams.

InvoiceCloud is committed to providing equal employment opportunities to all employees and applicants. We do not tolerate discrimination or harassment of any kind based on race, color, religion, age, sex, nationality, disability, genetic information, veteran or military status, sexual orientation, gender identity or expression, or any other characteristic protected under applicable laws.

This commitment applies to all aspects of employment, including recruitment, hiring, placement, promotion, termination, layoff, recall, transfer, leave, compensation, and training.

If you require a disability-related or religious accommodation during the application or recruitment process, and wish to discuss possible adjustments, please contact jobs@invoicecloud.com.

Click here to review InvoiceCloud’s Job Applicant Privacy Policy.

For recruitment agencies: InvoiceCloud does not accept unsolicited resumes from agencies. Please do not forward resumes to our job aliases, employees, or any other company location. InvoiceCloud is not responsible for any fees associated with unsolicited submissions.

Meet JobCopilot: Your Personal AI Job Hunter