Senior AI Engineer (Ops)

Latitude

2d • Remote

About The Position

This role will own the configuration, analytics, and monitoring for our production AI systems. You will develop internal AI agents, automations, and dashboards to ensure our product’s AI-powered features run reliably and cost-effectively.

Requirements

• Knowledge of generative AI approaches, research landscape, and model inference configurations
• Strong coding skills in TypeScript/JavaScript, Python, or similar languages
• Experience building production systems with external APIs and managing third-party service integrations
• Familiarity with observability tools (Grafana, Prometheus, etc.) and databases (PostgreSQL)
• Ability to think systematically about reliability, performance, and cost trade-offs
• Comfortable working in a fast-paced environment where you'll need to balance quick iteration with production stability

Responsibilities

• Build and maintain AI request handlers, generation configs, and routing logic for our third-party model inference providers
• Implement monitoring systems, dashboards, and alerting for production AI system health, performance, and costs
• Design metrics for analyzing the health and efficiency of our production AI resources
• Create agentic automations for common AI infrastructure tasks and analytics pipelines
• Manage database schemas for AI configurations and evaluation data
• Work with the team to define best practices for AI system reliability and observability

Benefits

• Medical, dental, and vision coverage, with the company paying 100% of premiums for employees and eligible dependents (subject to plan terms and eligibility; benefits vary by location). HSA options are available depending on the selected plan.
• Company-provided laptop (Mac by default) and the tools you need to do your best work.
• Flexible PTO, encouraged and supported. Many teammates take around 2 days per month plus additional time each quarter, depending on role and team planning.
• Access to the latest AI models to accelerate your work.
• $100/month Learning Fund for books, courses, coaching, conferences, and video games. We believe great builders learn from everywhere.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed