About The Position
As part of the AWS Applied AI Solutions organization, we're advancing the frontier of AI platform capabilities and evaluation methodologies. Our vision is to be the trusted foundation for transforming every business with Amazon AI teammates. Our mission is to deliver turnkey, enterprise-grade foundational AI capabilities that create delightful AI powered solutions. We're building sophisticated AI systems that enable builders to efficiently build, deploy, and operate AI solutions at scale, with particular focus on specialized content processing and runtime evaluation of AI agents. As an Applied Scientist, you'll explore emerging opportunities at the intersection of AI platform capabilities and applied science. You'll investigate novel approaches to specialized content processing, develop methods for agent evaluation, and validate ideas through rigorous experimentation with production systems. You'll collaborate with other scientists and engineers to identify where science can provide differentiation, work directly with platform teams to understand technical constraints, and help shape the future direction of AI platform capabilities as customer signals emerge. Our team is a central science organization supporting multiple product teams across AWS Core Services. We tackle fundamental challenges in AI and machine learning that require novel approaches beyond off-the-shelf solutions. Working at the intersection of machine learning, large language models, and domain-specific applications, we develop practical techniques that advance the state-of-the-art while maintaining a clear path to customer impact. Our team builds deep domain expertise across geospatial intelligence, trust and safety systems, autonomous operations, and other critical areas, collaborating closely with engineering teams to transform research insights into scalable production solutions.
Requirements
- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
Nice To Haves
- Experience using Unix/Linux
- Experience in professional software development
Responsibilities
- Develop specialized PII and PHI detection methods for domain-specific contexts where general-purpose models struggle with regulatory requirements or specialized language
- Create runtime evaluation frameworks for AI agents that identify model drift and trigger automated improvement processes
- Research novel approaches to content redaction that balance privacy protection with operational efficiency
- Design evaluation methodologies that assess agent performance across diverse operational contexts
- Collaborate with platform engineering teams to integrate science components into foundational infrastructure
- Conduct rigorous experimentation and establish evaluation frameworks to measure agentic solution performance
Benefits
- health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
- 401(k) matching
- paid time off
- parental leave
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
