Centene Corporation logo
Centene Corporation

Centene Corporation is a Fortune 500, mission-driven healthcare leader committed to transforming the health of the communities we service, one person at a time.

Principal AI Governance Scientist – Artificial Intelligence

Location

Florida + 3 moreAll locations: Florida, Nebraska, Missouri, Washington

Posted

5 days ago

Salary

$134.6K - $249K / year

Seniority

Lead

Bachelor Degree6 yrs expEnglishPythonPyTorch

Job Description

• Leads the technical evaluation and assurance efforts within our AI Governance team • Establishes enterprise-grade, decision-relevant methodologies for red teaming, testing, and evaluating AI systems across traditional ML, Generative AI, and Agentic AI applications • Develops reproducible frameworks to measure AI value, user impact, and broader outcomes • Designs rigorous evaluation methodologies for assessing AI system performance, safety, reliability, and alignment with intended use across the AI lifecycle • Develops criteria and benchmarks to determine whether existing evaluations are adequate and sufficient for different AI applications and risk profiles • Designs and executes comprehensive red team exercises to identify vulnerabilities, failure modes, and unintended behaviors across diverse AI systems • Establishes standards for evaluation coverage, rigor, and documentation across the AI lifecycle • Advances the scientific understanding of AI evaluation and safety through white papers and trainings • Provides technical leadership and mentorship to scientists, engineers, and compliance professionals while building organizational evaluation capabilities • Stays at the forefront of AI safety research and identify novel risks emerging from advanced AI capabilities • Translates complex technical findings into actionable recommendations for leadership, governance boards, and cross-functional teams • Collaborates with external researchers, institutions, and industry partners to advance evaluation methodology

Job Requirements

  • Bachelor's Degree Computer Science, Machine Learning, Statistics, or related quantitative field; or equivalent experience required
  • Master's Degree preferred
  • 6+ years AI/ML research, including 3+ years focused on model evaluation, safety, or robustness required
  • 8+ years preferred
  • Deep technical expertise in modern AI systems with hands-on experience evaluating large language models, generative AI, and/or agentic systems required
  • Proven track record designing rigorous evaluation methodologies and publication record required
  • Strong foundation in statistical methods, experimental design, causal inference, and excellent Python programming skills with ML frameworks required
  • Familiarity with Python‑based AI/ML stack using PyTorch and Databricks, with agentic AI frameworks (LangChain, LlamaIndex, LangGraph, AutoGen, CrewAI) for single‑ and multi‑agent systems
  • Strong focus on LLM observability, MLOps, and evaluation using LangSmith, MLflow, Weights & Biases, Datadog, OpenTelemetry, and testing frameworks like DeepEval and LangTest

Benefits

  • competitive pay
  • health insurance
  • 401K and stock purchase plans
  • tuition reimbursement
  • paid time off plus holidays
  • a flexible approach to work with remote, hybrid, field or office work schedules

Related Job Pages

More Artificial Intelligence Jobs

BlueCross BlueShield of Tennessee logo

AI Member Experience Quality Analyst

BlueCross BlueShield of Tennessee

Bringing peace of mind through better health to our customers and communities

Full TimeRemoteTeam 5,001-10,000Since 1952H1B Sponsor

AI Member Experience Quality Analyst evaluating AI interactions in healthcare.

Tennessee
XALT logo

Atlassian AI Consultant

XALT

Our mission is to make complex IT projects feel simple and uncomplicated.

Full TimeRemoteTeam 11-50H1B Sponsor

Atlassian AI Consultant supporting organizations in optimizing collaboration and agile processes

United States
General Motors logo

Staff Software Engineer, Vehicle AI

General Motors

General Motors (GM), founded in 1908 by William "Billy" Durant in Flint, Michigan, began with the Buick Motor Company and later acquired brands like Oldsmobile

Full TimeRemoteTeam 165,000Since 1908

Lead design, implement, and deploy scalable AI agents and infrastructure. Drive technical strategy, mentor engineers, collaborate cross-functionally, perform system and code reviews, and resolve architectural and performance challenges.

California
$189.3K - $290K / year
General Motors logo

Senior Software Engineer, Vehicle AI

General Motors

General Motors (GM), founded in 1908 by William "Billy" Durant in Flint, Michigan, began with the Buick Motor Company and later acquired brands like Oldsmobile

Full TimeRemoteTeam 165,000Since 1908

Lead design, development, and production deployment of scalable AI agents and agent platforms. Drive architecture, technical strategy, code and system reviews, mentor teams, and resolve performance and architectural challenges.

California
$174.9K - $222K / year