AI Product Testing Engineer

Virtue AI • San Francisco, CA

15h • Hybrid

About The Position

Virtue AI sets the standard for advanced AI security platforms. Built on decades of foundational and award-winning research in AI security, its AI-native architecture unifies automated red-teaming, real-time multimodal guardrails, and systematic governance for enterprise apps and agents. We are a well-funded, early-stage startup founded by industry veterans, and we're looking for passionate builders to join our core team.
As a Testing Engineer, you will be responsible for ensuring the functionality, reliability, and quality of our proprietary AI platform, focusing on both product features and backend systems. Your work will involve traditional QA/system testing combined with cutting-edge AI security validation.
You will:
Design and execute comprehensive test plans for new product features, focusing on end-to-end functionality and user experience.
Develop and automate system-level test cases for backend APIs, data pipelines, and platform reliability.
Contribute to the optimization of the overall testing platform and CI/CD pipelines.
Perform comprehensive model evaluations and analyze the results to ensure robust product behavior.
Apply and develop core techniques for agent and model red-teaming, including designing new red-teaming methods to discover security vulnerabilities.
Collaborate closely with backend, ML, and infra teams to align testing strategy with product requirements and deployment realities.
Communicate with customers to understand customer requirements and be involved in product planning and management.
You’ll thrive in this role if you’re excited by new technology, love solving customer problems, and can comfortably bridge the business and technical worlds.

Requirements

• Bachelor’s degree in CS, CE, EE, or a related field.
• Proficiency in programming languages such as Python.
• Strong experience in software testing (especially AI-related software) methodologies, including test case design, automation, and defect tracking.
• Deep experience with backend testing, including API testing (e.g., REST/gRPC) and performance testing.
• Experience with containerization and deployment tools like Docker and Kubernetes.
• Strong problem-solving skills and effective communication abilities.

Nice To Haves

• Experience developing LLM-related and AI agent-related products.
• Hands-on experience in back-end (Go, C/C++) or front-end development (Node.js, Typescript).
• Familiarity with LLM libraries like PyTorch, HuggingFace, or agent development kits.
• Enthusiasm for thriving in a fast-paced startup environment.

Responsibilities

• Design and execute comprehensive test plans for new product features, focusing on end-to-end functionality and user experience.
• Develop and automate system-level test cases for backend APIs, data pipelines, and platform reliability.
• Contribute to the optimization of the overall testing platform and CI/CD pipelines.
• Perform comprehensive model evaluations and analyze the results to ensure robust product behavior.
• Apply and develop core techniques for agent and model red-teaming, including designing new red-teaming methods to discover security vulnerabilities.
• Collaborate closely with backend, ML, and infra teams to align testing strategy with product requirements and deployment realities.
• Communicate with customers to understand customer requirements and be involved in product planning and management.

Benefits

• Competitive base salary compensation + equity commensurate with skills and experience.
• Impact at scale – Help define the category of AI security and partner with Fortune 500 enterprises on their most strategic AI initiatives.
• Work on the frontier – Engage with bleeding-edge AI/ML and deploy AI security solutions for use cases that don't yet exist anywhere else.
• Collaborative culture – Join a team of builders, problem-solvers, and innovators who are mission-driven and collaborative.
• Opportunity for growth – Shape not only our customer engagements, but also the processes and culture of an early lean team with plans for scale.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level