About the position
As a Senior Product Analyst at Hippocratic AI, you will be primarily responsible for reviewing production calls, analyzing call data, and creating reports to support the continuous improvement of our healthcare-focused LLM solutions. In this role, you'll help ensure our data is meticulously labeled and evaluated, perform second-level reviews of externally labeled data, and create reports based on labeled data and patient call outcomes. Your work will directly influence the accuracy and reliability of Hippocratic AI's solutions, helping maintain high standards of patient safety and experience. You'll collaborate with cross-functional teams-including engineering, product, and clinical experts-to troubleshoot data tasks, debug labeling complexities, and provide succinct insights. You will have extensive exposure to building a highly technical LLM product with lots of mentorship and growth opportunities.
Responsibilities
- Data Labeling & Quality Control: Conduct second-level reviews/adjudications of nurse-produced labels to ensure accuracy and consistency.
- Analytics & Reporting: Gather relevant datasets by running SQL queries or by running Python scripts.
- Produce weekly data summaries and reports that help the broader team understand the health of the product.
- Track and document metrics or issues that arise during labeling, contributing to process improvements.
- Collaboration & Debugging: Work closely with engineering and product teams to clarify labeling guidelines and address edge-case scenarios.
- Communicate findings clearly and succinctly, highlighting patterns or problems for cross-functional teams.
Requirements
- Bachelor's degree in Data Science, Statistics, Computer Science, or related field.
- 5+ years of experience in roles related to product analytics or data science, with preference for experience working directly with a product used by external users.
- Experience writing and using python scripts to conduct data analysis.
- Experience analyzing data and creating reports.
- Experience writing SQL queries.
- Strong attention to detail, with a track record of accurately following instructions and processes.
- Solid communication skills; able to convey findings to both technical and non-technical stakeholders.
- Ability to stay organized and manage multiple tasks in a fast-paced environment.
Nice-to-haves
- Experience analyzing the health of products built on top of LLMs or other probabilistic models.
- Understanding of healthcare or clinical workflows.
- Experience working in a startup or fast-growing company.
Benefits
- Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
- Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
- Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA's NVentures, Premji Invest, SV Angel, and six health systems.
- World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
