Product Manager, Models

HeidiSan Francisco, CA
4dHybrid

About The Position

We're looking for a Product Manager to own the AI models that power everything Heidi does. Someone who thinks platform teams exist to make product teams faster. You will own Heidi's models platform: evaluation pipelines, fine-tuning infrastructure, model routing, and safety systems. Hundreds oåeek. You'll work with engineers and researchers, partner with product PMs and clinical safety, and stay close enough to product teams that you know what they need before they file a ticket. You will report into Product leadership. This is a platform role. Every user-facing product at Heidi depends on what your team builds. This role will be based in either our Sydney or Melbourne office. We don't care about logos; the traditional insignia of competence. We'll evaluate senior well-credentialed candidates and young, hungry hopefuls alike. If you're an engineer who's been living inside these models and wants to move up a layer of abstraction into product, we want to hear from you.

Requirements

  • 4+ years working on AI platform, infrastructure, or model-adjacent products, though we care more about what you've built than time served
  • Technical depth on model evaluation, fine-tuning, and production AI systems. You've designed eval suites, debugged model regressions, and understand what makes models fail in production.
  • Genuine curiosity about what models get wrong in clinical settings and why
  • Technical enough to hold your own with your engineers, credible enough to present safety trade-offs to leadership
  • You use AI tools to do your own work, not just manage people who do
  • Strong opinions, weakly held. You'll shift the room when you're right. Willingness to update your views when the technology shifts, which it does roughly quarterly.
  • Data fluency with diagnostic teeth - can you read evaluation results and distinguish a real regression from noise? Can you design an eval that catches the thing your current suite misses?
  • Are you an execution powerhouse?
  • Have you worked on AI products where model quality directly affected end users?
  • Can you allocate engineering resources across competing priorities and defend the split?
  • Are you comfortable making decisions with incomplete information, then revising them when the picture changes?
  • Are you able to execute without a legion of data analysts, product marketers, and research coordinators at your beck and call?
  • Does the prospect of re-energising our health systems make you feel fuzzy inside?

Responsibilities

  • Own product strategy and roadmap for Heidi's models platform (evaluation, safety, model routing, fine-tuning infrastructure), setting clear goals and being held accountable to achieving them
  • Prioritise your team's work across enablement requests, model safety and quality, and bets on new capabilities
  • Figure out where product teams get stuck on your models and fix the platform so they don't
  • Build eval tooling and fine-tuning workflows that your engineers and product teams can actually use in clinical settings
  • Decide what to improve next by reading clinician feedback, model quality signals, and what product teams are asking for
  • Allocate engineering capacity across product teams who all want more than you can give, and tell them clearly what you're deferring
  • Work with your engineers on eval design, fine-tuning trade-offs, and model architecture decisions at a technical level
  • Set model quality and safety targets grounded in clinical outcomes (did the note capture the right diagnosis? did the referral letter contain the right history?)
  • Spot infrastructure that two product teams are building separately and consolidate it
  • Watch foundation model developments and decide when to rip up your roadmap

Benefits

  • Flexible hybrid working environment, with 3 days in the office.
  • A generous personal development budget of $500 per annum
  • Learn from some of the best engineers and creatives, joining a diverse team
  • Become an owner, with shares (equity) in the company, if Heidi wins, we all win
  • The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
  • If you have an impact quickly, the opportunity to fast track your startup career!
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service