AI Engineer / Senior Platform Support Officer

State Street • Quincy, MA

3d

About The Position

This is an L3 Support Engineer / Senior Platform Support Specialist position within the Generative AI Team . Our primary objective is to ensure the reliability, performance, and operational excellence of enterprise-grade Generative AI platforms spanning Azure and AWS ecosystems — specifically Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock . As a member of the Global AI Team, the incumbent will serve as the highest tier of technical support and escalation, partnering with development teams, infrastructure teams, cloud engineering, and business stakeholders across regions to diagnose complex issues, drive root cause analysis, optimize platform performance, and ensure seamless availability of Gen AI services that power critical business functions.

Requirements

• Deep hands-on expertise with Azure AI services , including Azure OpenAI Service (GPT model deployments, fine-tuning, content filtering, quota management), Azure AI Foundry (prompt flow, model catalog, evaluation tools), and Azure Cognitive Services.
• Deep hands-on expertise with AWS AI/ML services , including AWS Bedrock (foundation model access, custom model import, agents, knowledge bases, guardrails), and associated AWS services (Lambda, S3, IAM, CloudWatch, SageMaker).
• Strong working knowledge of Databricks , including Unity Catalog, MLflow, model serving endpoints, Delta Lake, Spark clusters, workflows/jobs, and integration with Gen AI pipelines.
• Proficiency in Python and scripting (Bash/PowerShell) for troubleshooting, log analysis, API testing, and automation of support tasks.
• Strong understanding of cloud networking, security, and identity management — VNets/VPCs, NSGs/Security Groups, Private Endpoints/PrivateLink, Azure AD/Entra ID, AWS IAM, RBAC, managed identities, and service principals.
• Experience with API troubleshooting — REST APIs, authentication/authorization flows (OAuth 2.0, API keys, SAS tokens), rate limiting, retry logic, and HTTP status code analysis.
• Familiarity with Infrastructure as Code (IaC) tools such as Terraform, ARM Templates, CloudFormation, or Bicep for understanding and troubleshooting deployed infrastructure.
• Experience with monitoring and observability tools — Azure Monitor, Application Insights, Log Analytics, AWS CloudWatch, CloudTrail, Databricks cluster logs, Grafana, or similar platforms.
• Working knowledge of containerization and orchestration — Docker, Kubernetes (AKS/EKS), and container-based model serving architectures.
• Understanding of LLM concepts and Gen AI architectures — prompt engineering, RAG (Retrieval Augmented Generation), embeddings, vector databases (e.g., Azure AI Search, Pinecone, FAISS), token management, and model lifecycle management.
• Experience with CI/CD pipelines and DevOps/MLOps practices — Git, Azure DevOps, GitHub Actions, Jenkins, and deployment automation relevant to AI/ML workloads.
• Strong knowledge of ITIL processes — Incident Management, Problem Management, Change Management, and Service Level Management.
• Excellent analytical skills, critical thinking, and structured problem-solving abilities with the capacity to work under pressure during high-severity incidents.
• Outstanding communication skills — ability to articulate complex technical issues clearly to both technical and non-technical stakeholders, and to produce high-quality incident reports and documentation.
• Strong organizational skills with the ability to manage multiple concurrent issues, prioritize effectively, and meet SLA commitments in a fast-paced, cross-functional environment.
• Bachelor's Degree in Computer Science, Engineering, Information Technology, or a related field.
• 3+ years of experience in production support, platform engineering, cloud operations, or site reliability engineering (SRE), with at least 2+ years focused on AI/ML or Gen AI platforms .
• Demonstrated experience supporting enterprise-scale cloud environments in financial services, consulting, or similarly regulated industries.

Nice To Haves

• Certifications (Preferred — one or more of the following): Azure: AZ-104 (Azure Administrator), AZ-305 (Azure Solutions Architect), AI-102 (Azure AI Engineer), AZ-400 (Azure DevOps Engineer) AWS: AWS Solutions Architect Associate/Professional, AWS Machine Learning Specialty, AWS Cloud Practitioner Databricks: Databricks Certified Data Engineer, Databricks Certified Machine Learning Professional ITIL v4 Foundation or higher

Responsibilities

• Serve as the final escalation tier (L3) for complex production incidents related to Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock, driving resolution with urgency and precision.
• Perform advanced root cause analysis (RCA) on platform outages, performance degradation, model inference failures, token/rate-limiting issues, API errors, and integration breakdowns across multi-cloud Gen AI environments.
• Monitor, maintain, and optimize the health, performance, and cost-efficiency of Gen AI workloads across Azure and AWS, including model deployments, endpoints, fine-tuning pipelines, and orchestration workflows.
• Troubleshoot end-to-end architecture spanning API gateways, networking (VNets, VPCs, Private Endpoints, PrivateLink), IAM/RBAC policies, model serving infrastructure, vector databases, and data pipelines integrated with Gen AI services.
• Collaborate closely with L1/L2 support teams to develop runbooks, knowledge base articles, escalation procedures, and standard operating procedures (SOPs) to reduce mean time to resolution (MTTR) and enable shift-left support.
• Partner with Development, MLOps, and Infrastructure teams to identify recurring issues, recommend platform improvements, and contribute to the reliability and resilience of Gen AI solutions through proactive measures.
• Support deployment and release activities for Gen AI models and applications, including validation of model endpoints, API versioning, configuration changes, and rollback procedures in production environments.
• Manage and respond to incidents following ITIL-aligned incident and problem management processes, including SLA adherence, stakeholder communication, and post-incident reviews.
• Drive automation of support workflows by developing scripts, monitoring dashboards, alerting mechanisms, and self-healing capabilities to improve operational efficiency.
• Stay current with platform updates, deprecations, and new feature releases from Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock, assessing impact on existing deployments and advising teams accordingly.
• Work with Enterprise Architecture and Security teams to ensure Gen AI platform configurations conform to organizational standards, compliance requirements, and data governance policies.
• Provide technical guidance and mentorship to L1/L2 support engineers, fostering skill development and knowledge transfer across the support organization.
• Participate in on-call rotations and provide after-hours support for critical production issues as required.

Benefits

• Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level