Related skills
testing python ai governance generative ai llmπ Description
- Lead end-to-end AI risk assessments for GenAI and LLM use cases across the Bank.
- Coordinate cross-functional SMEs: Legal, Compliance, InfoSec, Data Gov, MRM, ERM.
- Review AI system design, docs, guardrails, and change management.
- Assess pre-deployment testing: accuracy, bias, safety, edge cases, UAT.
- Monitor ongoing metrics: accuracy, hallucinations, drift, privacy controls.
- Develop templates and tools to scale AI risk governance.
π― Requirements
- 5+ years in risk management, or 3+ years with MS/PhD; or equivalent.
- Proficiency in Python for evaluating AI system behavior.
- Strong understanding of generative AI (LLMs, transformers, RAG) and evaluation.
- Knowledge of interagency model risk management principles (SR 26-2).
- Knowledge of AI testing (functional, bias, adversarial) and data privacy.
- Excellent communication to non-technical stakeholders and regulators.
- Strong analytical judgment; manage multiple assessments with minimal oversight.
π Benefits
- Remote work options
- Medical insurance
- Flexible time off
- Retirement savings plans
- Family planning benefits
- Inclusive interview process with accommodations
Meet JobCopilot: Your Personal AI Job Hunter
Automatically Apply to Data Jobs. Just set your
preferences and Job Copilot will do the rest β finding, filtering, and applying while you focus on what matters.
Help us maintain the quality of jobs posted on Empllo!
Is this position not a remote job?
Let us know!