QA Analyst

QA EngineerQA EngineerFull TimeRemoteSeniorTeam 1,001-5,000Company SiteLinkedIn

Location

Arizona

Posted

2 days ago

Salary

$70K - $105K / year

Seniority

Senior

Bachelor Degree4 yrs expEnglish

Job Description

• Validate AI-generated artifacts, recommendations, and decisions produced by autonomous and semi-autonomous agents. • Evaluate outputs for accuracy, relevance, completeness, hallucination risk, and alignment with provided context modules and knowledge sources. • Test end-to-end agent workflows across the full lifecycle: Intent → Objective → Plan → Execution → Artifacts → Memory → Evolution. • Partner with Legal, Compliance, and Data teams to ensure QA coverage for regulated workflows, including healthcare-grade auditability and review readiness. • Contribute to the design of automated testing frameworks for agentic systems, including regression testing of AI outputs over time.

Job Requirements

  • 4+ years of experience in Quality Assurance, Test Engineering, or Product Quality roles within complex software platforms.
  • Hands-on experience testing AI-enabled, data-driven, or workflow-oriented systems.
  • Proven ability to validate non-deterministic outputs where “correctness” is probabilistic rather than binary.
  • Strong understanding of QA methodologies across functional, integration, regression, and UAT testing.
  • Experience designing test cases for LLMs, generative AI systems, or intelligent automation.
  • Ability to reason about agent behavior, execution traces, and output quality across multi-step workflows.
  • Familiarity with Agile delivery environments and tools such as JIRA, Confluence, or similar.
  • Exceptional attention to detail and comfort working with complex system states and abstractions.

Benefits

  • medical
  • dental
  • 401(k)
  • tuition reimbursement
  • flexible time off

Related Categories

Related Job Pages

More QA Engineer Jobs

Full TimeRemoteTeam 51-200Since 2007

Director of Quality Assurance at Tonix Pharmaceuticals overseeing clinical and nonclinical studies.

Google Cloud Platform
United States
$150K - $240K / year
Pano AI logo

Senior Process Quality Engineer

Pano AI

The leader in early wildfire detection and actionable intelligence

QA Engineer2 days ago
Full TimeRemoteTeam 51-200Since 2019

Senior Process Quality Engineer ensuring quality of AI-driven wildfire detection systems

AssemblyCloud
United States
$137K - $183K / year
Full TimeRemote

Elcomplus Inc. is a US company headquartered in Miami, Florida. We provide companies worldwide with reliable communications to increase the effectiveness of their operations. We produce specialized software and hardware and build radio systems. From ye...

Florida
Symetra logo

Quality Assurance Analyst

Symetra

Symetra is a national financial services company dedicated to helping people achieve their financial goals and feel confident about the future. In our daily work, we’re guided by the principles of Value, Transparency and Sustainability. We provide products and services people need at a competitive price. We communicate clearly and openly so people understand what they’re buying. We design products—and operate our company—to stand the test of time. We’re committed to showing up for our communities, lifting up our employees, and standing up for diversity, equity and inclusion (DEI).

QA Engineer2 days ago
Full TimeRemoteTeam 1,001-5,000

The analyst will ensure financial and non-financial transactions and interactions adhere to regulatory requirements, quality standards, and published procedures. Key duties include conducting reviews of transactions and customer interactions, documenting results, providing feedback, and acting as a subject matter expert for procedures and training.

Quality AssuranceFinancial ServicesComplianceRegulatory StandardsTrainingDocumentationData AnalysisReporting
United States
$25 - $41 / hour