Software Engineer, Account Abuse

Anthropic•San Francisco, CA

10h•Hybrid

About The Position

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. The Account Abuse team is tasked with ensuring Anthropic’s computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build systems that gather and analyze signals at scale, balancing tradeoffs and coordinating closely with stakeholder teams throughout the company. The ideal candidate can see things from opponents’ perspectives, understand their means and motives, and anticipate their responses to countermeasures.

Requirements

A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
3-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection.
Proficiency in Python, SQL, and data analysis tools.
Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders

Nice To Haves

Have experience building trust and safety mechanisms for and using AI/ML systems, such as fraud-detection models or security monitoring tools or the infrastructure to support these systems at scale
Have worked closely with operational teams to build custom internal tooling

Responsibilities

Ability to think and respond quickly in a rapidly-changing greenfield environment
Jumping into other teams’ code to identify key points to gather signals or introduce interventions with minimal impact on their systems’ stability, complexity, or overall architecture
Integration with third-party data-enrichment vendors
Creating monitoring dashboards, alerts, and internal admin UX
Working closely with our data scientists to maintain situational awareness of our current usage patterns and trends, and with our Policy & Enforcement team to maximize the impact of their human-review availability
Building robust and reliable multi-layered defenses
Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns, uncover emerging attack vectors, and inform both immediate enforcement actions and longer-term systemic defenses