Director, Policy and Program Evaluation

Federation of State Medical Boards•Washington, DC

About The Position

Reporting to the Chief Policy Officer, the Director of Policy and Program Evaluation delivers strategic evaluation leadership across the Education and Policy functions, developing and implementing frameworks that measure outcomes, informing executive decision-making, and strengthen mission-critical impact. This role establishes and oversees integrated evaluation systems that assess effectiveness, quality, impact, and overall value in advancing FSMB’s mission across policy & education. The Director serves as a strategic advisor to executive leadership, translating research and performance data into actionable insights that inform strategy, innovation, and organizational priorities. FSMB is an EEO employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin or status as a protected veteran.

Requirements

Doctoral degree (Ph.D., Ed.D., Dr.P.H., or related discipline) strongly preferred. A master’s degree with 10+ years of progressively responsible enterprise-level evaluation experience may be considered.
7–10 years of experience designing, implementing, and leading enterprise-wide evaluation systems in complex organizations.
Demonstrated expertise in qualitative and mixed-methods research, including survey design, statistical analysis, and interview protocols.
Proven ability to translate research findings into strategic recommendations for executive decision-making.
Experience managing multi-project evaluation initiatives and external consultant relationships.
Experience presenting findings to executive leadership and governance bodies.

Nice To Haves

Deep understanding of medical regulation, professional licensure, continuing professional development, or healthcare quality and safety.
Knowledge of state medical board governance, regulatory frameworks, and operational dynamics.
Demonstrated success working with state and local government offices, agencies, and field practitioners to drive meaningful outcomes.
Professional certification in program evaluation (e.g., Credentialed Evaluator) or recognized research credentials.
Proven commitment to continuous improvement, ethical evaluation practices, and fostering organizational learning cultures.
Experience shaping organizational strategy and presenting findings to executive leadership and board-level governance bodies.

Responsibilities

Lead the development, implementation, and continuous refinement of integrated evaluation and research frameworks for policy and education programs.
Establish and oversee standardized methodologies, metrics, and governance practices to ensure rigor, consistency, and data integrity in policy and education programs.
Embed evaluation activities throughout program design, implementation, and continuous improvement cycles to strengthen organizational outcomes.
Guide the development of evaluation methodologies that capture both quantitative and qualitative dimensions of program effectiveness, including participant learning, knowledge translation, and impact on regulatory practice.
Partner with Education and Policy leadership to evaluate programs, identify trends, and recommend evidence-informed strategic enhancements.
Collaborate with cross-functional teams—including Communications, Research, and Member Services—to improve internal processes and advance organizational performance.
Facilitate cross-functional teams to interpret evaluation findings and embed them into program design and quality improvement cycles, prioritizing actions that drive measurable quality improvements in outcomes.
Provide strategic leadership for enterprise research initiatives that advance knowledge in medical regulation, continuing professional development, and public protection.
Align research design and portfolios with organizational priorities, ensuring methodological rigor through standardized frameworks and governance structures.
Identify opportunities to disseminate findings through peer-reviewed publications, conferences, and policy briefs, enhancing FSMB’s thought leadership.
Oversee the development of executive dashboards, analytical reports, and performance monitoring tools that provide timely, actionable insights.
Present findings to executive leadership and governance bodies, synthesizing complex data into strategic recommendations.
Integrate evaluation insights into enterprise strategic planning and multi-year organizational priorities.
Identify emerging trends, risks, and innovation opportunities through systematic performance analysis.
Establish and manage relationships with external research and evaluation partners, including RFP development, contract negotiation, and performance oversight.
Ensure deliverables meet quality standards, timelines, and methodological expectations.
Monitor evaluation-related budgets to ensure responsible stewardship and alignment with organizational priorities.
Maintain engagement with best practices in program evaluation, outcomes measurement, and organizational learning.
Participate in professional associations, peer organizations, and academic institutions to advance methodological innovation.
Mentor staff and strengthen internal evaluation capacity, fostering a culture of evidence-based decision-making.
Advise executive leadership and the Board on the strategic implications of evaluation and research findings.
Lead evidence-informed development of multi-year strategic and policy frameworks by synthesizing program outcomes, environmental scanning, and emerging trends.
Translate complex evaluation and research data into actionable insights, identifying systemic patterns, forecasting regulatory needs, and guiding forward-looking initiatives that advance FSMB’s mission.