Alight Solutions

Alight Inc. (NYSE: ALIT) is a leading cloud-based human capital technology and services provider

AI Quality Lead

Artificial IntelligenceArtificial IntelligenceFull TimeRemoteTeam 10,001+Since 2016H1B SponsorCompany SiteLinkedIn

Location

Illinois

Posted

7 days ago

Salary

$125K - $180K / year

Bachelor DegreeEnglish

Job Description

• Architect and drive the end-to-end AI Quality program from inception • Design and implement the unified AI Quality strategy and SOP, scaling controls by risk tier (Tier 1–3) • Define and own success metrics, risk tiering, acceptance criteria, and operating thresholds for AI solutions • Lead the development of golden/adversarial test suites (prompt injection, misuse, safety, bias, functional automation) • Oversee the creation and maintenance of schema-level UI/API tests, agent contracts, and observability instrumentation • Own the org-wide evaluation harnesses (e.g., promptfoo, TruLens, Ragas), CI gating, and red-team playbooks • Manage independent spot checks, factsheets, registry entries, and evidence for governance and audit • Collaborate with Product Owners, Developers, SRE/Observability, and Governance to ensure compliance and operational excellence • Drive continuous improvement in fairness, explainability, safety, security, and operational SLOs • Mentor and grow the AI Quality team, including onboarding and coaching junior engineers

Job Requirements

  • Experience leading or building quality engineering or testing programs
  • Ability to design and implement test strategies, automation frameworks, and quality standards
  • Excellent communication and leadership skills; ability to work cross-functionally and influence stakeholders
  • Experience with LLM, RAG, agentic, or classic ML systems
  • Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas)
  • Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360)
  • Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage)
  • Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices
  • Knowledge of international standards and regulatory frameworks for Responsible AI
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field, or equivalent experience

Benefits

  • Health coverage options
  • Wellbeing and support programs
  • Retirement
  • Vacation and sick leave
  • Maternity, paternity & adoption leave
  • Continuing education and training
  • Voluntary benefit options

Related Job Pages

More Artificial Intelligence Jobs

Artificial Intelligence7 days ago
Full TimeRemoteTeam 1,001-5,000Since 1938H1B Sponsor

Director of AI and Automation driving business transformation and operational efficiency

AWSAzureCloudCyber SecurityRPA
Pennsylvania
$142.4K - $268.3K / year
Full TimeRemoteTeam 1,001-5,000

The Data Visualization Engineer will architect, develop, and maintain enterprise-grade Power BI semantic models, reports, and dashboards, focusing on performance and adherence to UX standards. This role also involves designing complex DAX measures, implementing security, and optimizing data models using best practices like star schema and incremental refresh.

United States
$115K - $130K / year
Artificial Intelligence7 days ago
Full TimeRemoteTeam 501-1,000

This strategic role involves developing and executing the company's AI strategy, including defining service offerings, go-to-market plans, and client engagement strategies. The director will also build and lead an internal AI-focused team while establishing the company as a thought leader in industrial AI.

United States

AI Red-Teamer — Adversarial AI Testing

24-MAG

This opportunity is available through a leading AI-driven work platform.

Artificial Intelligence7 days ago
ContractRemote

This role involves supporting a leading AI lab in identifying vulnerabilities and improving the safety of advanced conversational AI systems. Conduct adversarial testing of conversational AI systems Identify vulnerabilities such as jailbreaks, prompt injections, misuse cases, and...

United States + 1 moreAll locations: United States, Israel