Filevine
The Operating Core for Legal
Senior Quality Assurance Analyst
Location
United States
Posted
42 days ago
Salary
$110K - $140K / year
English
Job Description
• Lead quality efforts for complex features including AI powered call routing, inbound and outbound calling, and third party telephony integrations
• Design and execute comprehensive test strategies covering end-to-end workflows, integrations, and event driven systems
• Validate inbound call capture, recording, transcription, summarization, and downstream event notifications
• Test phone registration workflows, including business registration, A2P compliance, and SHAKEN/STIR related processes
• Ensure accuracy and reliability of AI generated conversations, call summaries, and data capture across varied scenarios
• Validate management applications used to configure call flows, routing logic, permissions, and reporting
• Identify edge cases related to dropped calls, transcription errors, AI confidence thresholds, and third party provider failures
• Contribute to and maintain QA documentation, standards, and the organizational knowledge base
• Partner with Product and Engineering to influence requirements, design decisions, and release readiness
• Drive continuous improvement by identifying gaps in processes, tooling, and test coverage
Job Requirements
- Advanced expertise in manual testing methodologies and test case design for complex systems
- Strong experience testing APIs, webhooks, and third party integrations
- Solid understanding of telephony concepts such as call flows, call routing, IVR behavior, and voicemail
- Experience validating AI or ML assisted features, including non deterministic outputs and regression risks
- Ability to assess transcription accuracy, conversational intent recognition, and AI response quality
- Experience testing event driven architectures and downstream data delivery
- Familiarity with compliance driven workflows, auditability, and data traceability
- Strong analytical and problem solving skills with attention to detail
- Excellent written and verbal communication skills, including clear defect documentation
- Ability to influence development teams and advocate effectively for quality initiatives.
Benefits
- Medical, Dental, & Vision Insurance (for full-time employees)
- Competitive & Fair Pay
- Maternity & paternity leave (for full-time employees)
- Short & long-term disability
- Opportunity to learn from a dedicated leadership team
- Centrally located open office building in Sugar House (onsite employees)
- Top-of-the-line company swag
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
QA Engineer42 days ago
Full TimeRemoteTeam 201-500Since 2014H1B No Sponsor
Senior QA Manager ensuring quality standards in food safety at The Farmer's Dog
United States
Director, Quality Engineering
Beacon BiosignalsOur mission is to improve human health by enabling rapid, targeted interventions through advanced brain analytics.
QA Engineer42 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Director of Quality Engineering leading a team for medical device compliance
Massachusetts
Mid-level Quality Assurance Engineer
Cybermedia Technologies, LLC (CTEC)1900 Campus Commons Drive Reston, VA 20191
QA Engineer42 days ago
Full TimeRemoteTeam 201-500Since 1996H1B No Sponsor
Mid-level Quality Assurance Engineer validating software functionality at CTEC
AzureJUnitSDLCSelenium
United States
Senior Quality Assurance Engineer
Cybermedia Technologies, LLC (CTEC)1900 Campus Commons Drive Reston, VA 20191
QA Engineer42 days ago
Full TimeRemoteTeam 201-500Since 1996H1B No Sponsor
Senior Quality Assurance Engineer ensuring software quality across enterprise systems
AzureJUnitSDLCSelenium
United States