• Lead the AI Evaluation team, owning staffing, coaching, performance management, and delivery of evaluation and testing frameworks • Manage the AI evaluation lifecycle — including pre-launch testing, simulation, and post-deployment health monitoring • Create domain-specific evaluation tracks (e.g., Compliance & Risk, Bot Experience, Agent Experience) • Operationalize human-in-the-loop testing, integrating reviewer feedback into continuous improvement loops • Oversee simulation environments for stress-testing LLMs and identifying hallucinations or performance regressions • Partner closely with AI Platform & Governance to implement evaluation metrics, reporting, and health signals • Develop dashboards and reporting frameworks to track evaluation coverage, accuracy, and confidence scores • Collaborate with Enablement, Speech Analytics, and Data Operations to ensure AI evaluation results inform retraining