Quality Assurance Engineer-III, Prime Video Ads QA

Amazon • Arlington, VA

6d

About The Position

Are you passionate about delivering high-quality advertising experiences at
scale? Join Amazon's Prime Video Ads QA team, where we ensure seamless ad
delivery across millions of customers worldwide. As a Sr. Quality Assurance
Engineer, you will:
- Design, develop, and maintain scalable test automation frameworks for Prime
Video Ads platform, ensuring high coverage across functional, integration, and
end-to-end testing.
- Lead org-level quality initiatives and define QA strategy & test plans across
multiple concurrent projects, collaborating with engineering, product, and data
science teams.
- Champion AI adoption in test automation — leveraging AI/ML tools to generate
test cases, predict risk areas, detect anomalies, and accelerate defect
resolution.
- Drive shift-left testing practices by embedding quality early in the software
development lifecycle, including requirements review and design validation.
- Mentor and guide junior QA engineers, establishing best practices and quality
standards across the team.
- Define and track quality metrics and KPIs, providing data-driven insights to
stakeholders on release readiness.
- Partner with data science and ML teams to validate ad delivery algorithms,
targeting logic, and measurement accuracy.
- Identify gaps in test coverage and proactively drive improvements to reduce
customer-impacting defects.
- Contribute to CI/CD pipelines, ensuring automated tests are integrated and
executed efficiently across build and deployment workflows.

Requirements

• 6+ years of quality assurance engineering experience
• 4+ years of delivering test frameworks, test tools, leading the QA projects and initiatives experience
• Bachelor's degree
• Knowledge of QA methodology and tools, with demonstrated experience in an QAE role
• Experience in manual testing
• Experience in automation testing

Nice To Haves

• 2+ years of UI Automation (preferably on mobile platforms) experience
• Knowledge of at least one modern object-oriented programming language such as C++, Java, Objective C

Responsibilities

• Design, develop, and maintain scalable test automation frameworks for Prime Video Ads platform, ensuring high coverage across functional, integration, and end-to-end testing.
• Develop and maintain E2E automation scripts using TypeScript with Concierge/TREx for real device automation, leveraging a layered architecture (Components → Features → Tests) with VQA for visual validation, Sauron for stream data verification, and integrated reporting via ReportBuilder/TestRail — ensuring robust and maintainable test coverage across VOD, Live Events DAI, Linear DAI, and Interactive Video Ads on Prime Video Living Room devices.
• Lead quality initiatives and define QA strategy across multiple concurrent projects, collaborating with engineering, product, and data science teams.
• Champion AI adoption in test automation — leveraging AI/ML tools to generate test cases, predict risk areas, detect anomalies, and accelerate defect resolution.
• Drive shift-left testing practices by embedding quality early in the software development lifecycle, including requirements review and design validation.
• Mentor and guide junior QA engineers, establishing best practices and quality standards across the team.
• Define and track quality metrics and KPIs, providing data-driven insights to stakeholders on release readiness.
• Partner with data science and ML teams to validate ad delivery algorithms, targeting logic, and measurement accuracy.
• Contribute to CI/CD pipelines, ensuring automated tests are integrated and executed efficiently across build and deployment workflows.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level