Prompt Engineer

Highmark Health • Pittsburgh, PA

1d • Remote

About The Position

JOB SUMMARY We are seeking a strategic and communicative Prompt Engineer to optimize our AI solutions and bridge the gap between AI capabilities and organizational needs. This role is crucial for ensuring our Large Language Models (LLMs) generate high-quality, relevant, and accurate outputs by developing, optimizing, and validating prompt engineering strategies. The ideal candidate will possess a strong understanding of LLM behavior, the ability to quickly absorb business processes and context, and a data-driven approach to rapid iteration and experimentation. You will design, develop, and test prompt engineering strategies using quantitative and qualitative metrics, conduct comprehensive prompt analysis, and document best practices. Collaborating closely with AI engineers, data scientists, clinical, and business teams, you will translate requirements into technical solutions and contribute to the performance and capabilities of our AI-powered applications. We are looking for someone with demonstrated ability in prompt design and optimization, excellent communication and critical thinking skills, and a passion for staying current with advancements in the field. Proficiency in Python, JavaScript, and TypeScript is a plus.

Requirements

• 3 years of experience working with large datasets and performing qualitative and quantitative data analysis using SQL or similar.
• 1 year of Proven track record of successfully designing and implementing effective prompts for LLMs.
• 1 year of experience working with unstructured data and outputs.
• Proficiency in designing and evaluating prompts for different tasks (e.g., text generation, question answering, code generation).
• Excellent problem-solving and analytical skills.
• Ability to work independently and as part of a team.
• Ability to effectively communicate complex AI concepts to both technical and non-technical audiences.
• Strong presentation skills to convey insights and recommendations to stakeholders
• Commitment to staying up-to-date with the latest advancements in AI and related technologies.
• Bachelor’s degree in Business, Computer Science, Data Science, or related field or relevant experience and/or education as determined by the company in lieu of bachelor's degree.

Nice To Haves

• Strong understanding of clinical workflows and the healthcare environment.
• AI certifications with Google Language (Other than English):

Responsibilities

• Design, develop, and test various prompt engineering strategies to improve the quality and consistency of LLM outputs, using quantitative and qualitative metrics.
• Conduct comprehensive prompt analysis to identify areas for optimization, including clarity, specificity, and bias mitigation.
• Document best practices and guidelines for prompt engineering within the team, for example maintaining libraries of effective prompts and prompt templates for various applications.
• Collaborate with engineers and researchers to integrate optimized prompts into our applications and pipelines.
• Stay up-to-date with the latest advancements in prompt engineering.
• Rapidly absorb stakeholder’s business processes, context, and data to be confident manipulating it and doing first pass accuracy assessment.
• Providing and explaining reports regarding AI outcomes and performance
• Other duties as assigned or requested.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees