AI Solutions Analyst

World Bank Group • Washington, DC

5d

About The Position

Working at the World Bank Group provides a unique opportunity for you to help our clients solve their greatest development challenges. The World Bank Group is one of the largest sources of funding and knowledge for developing countries; a unique global partnership of five institutions dedicated to ending extreme poverty, increasing shared prosperity and promoting sustainable development. With 189 member countries and more than 130 offices worldwide, we work with public and private sector partners, investing in groundbreaking projects and using data, research, and technology to develop solutions to the most urgent global challenges. For more information, visit www.worldbank.org

ITS Vice Presidency Context

The Information and Technology Solutions (ITS) Vice Presidential Unit (VPU) enables the World Bank Group to achieve its mission of ending extreme poverty and boost shared prosperity on a livable planet by delivering transformative information and technologies to its staff working in over 150+ locations. For more information on ITS, see this video: https://www.youtube.com/watch?reload=9&v=VTFGffa1Y7w

Unit Context:

The ITS Data Office is the central entity within the World Bank Group’s Information and Technology Solutions (ITS) department responsible for enabling data, AI, information, and knowledge capabilities across the institution. It comprises four Units focused on platforms & tools, product & service delivery, enablement and governance. The office plays a pivotal role in advancing the Bank’s digital transformation, supporting business domains with trusted data, information and AI capabilities, and fostering a culture of responsible innovation.

The Platforms & Tools unit is responsible for building, integrating, and continuously modernizing the foundational technology infrastructure that powers data, AI, archives, and knowledge services across the World Bank Group. The unit leads the rationalization and simplification of legacy systems, and modernization towards platforms that are scalable, secure, interoperable, and designed for self-service and adoption. The unit plays a critical role in enabling enterprise-wide transformation by delivering data environments, digitization infrastructure, and open knowledge repositories that are AI-ready and aligned with business needs.

Duties and accountabilities:

Role Purpose:

The AI Solutions Analyst is responsible for supporting the organization’s research, development, and implementation of advanced Artificial Intelligence (AI) solutions to meet business needs. With guidance, this role identifies opportunities for AI technology application, optimizes existing models, and integrates AI technologies into current workflows to enhance operational efficiency and effectiveness. The AI Solutions Analyst also supports business stakeholders with applying AI tools to drive continuous Improvement.

Requirements

• Bachelor’s or Master’s degree with 2 years of experience or equivalent combination of education and experience (for example in IT field: Bachelor’s Degree with min 1 year of related work experience.)
• Automation and Robots – Skilled
• AI Modeling – Skilled
• Computer Vision – Skilled
• Deep Learning – Skilled
• Generative AI Intelligence (AI) – Advanced
• Large Language Models (LLMs) – Skilled
• Machine Learning – Skilled
• DevOps – Advanced
• Programming/Coding – Advanced
• Site Reliability Engineering – Skilled
• Infrastructure as Code (IaC) – Skilled
• Analytical Reasoning – Advanced
• Problem-Solving – Expert
• Critical Thinking – Expert

Nice To Haves

• SAFe Practitioner
• Microsoft/Google/AWS Certified AI Engineer

Responsibilities

• Support the development and enhancement of enterprise AI platform capabilities across Azure AI Foundry, AWS Bedrock, and Google Vertex AI
• Assist in building and maintaining integrations that unify foundation models into a model-agnostic, governed platform
• Contribute to the development of model deployment pipelines for LLMs, RAG architectures, and generative AI solutions
• Support the implementation of reusable components, SDKs, and accelerators that enable teams to leverage enterprise AI platforms
• Assist in implementing Model Context Protocol (MCP) and other emerging integration patterns
• Work closely with LOB teams and business-led IT initiatives to understand AI platform requirements
• Translate business needs into platform capability requirements and technical specifications
• Support proof-of-concept development to validate AI platform capabilities for business use cases
• Assist in aligning platform capabilities with evolving business needs and priorities
• Communicate platform capabilities and roadmap to business stakeholders
• Support the implementation of LLM observability including end-to-end tracing of prompts, responses, and intermediate steps across AI agents and workflows
• Assist in building dashboards to track platform health, model performance, latency, token usage, and cost metrics
• Contribute to monitoring infrastructure that provides visibility into RAG pipelines, tool calls, and multi-step agent behavior
• Help implement anomaly detection and alerting for quality degradation, latency spikes, and error patterns
• Support integration with observability tools and frameworks (e.g., OpenTelemetry, LangSmith, Langfuse, Arize) to enable tracing and debugging
• Assist in tracking and reporting on AI platform usage patterns and cost optimization opportunities
• Support the implementation of LLM evaluation frameworks to assess model output quality, relevance, accuracy, and safety
• Assist in building automated evaluation pipelines using LLM-as-a-Judge approaches and custom scoring metrics
• Contribute to evaluation workflows for RAG systems including groundedness, context relevance, and answer quality
• Help establish datasets and golden test cases for regression testing and continuous quality monitoring
• Support human-in-the-loop annotation workflows for quality assessment and feedback collection
• Assist in implementing safety and bias detection evaluations to ensure responsible AI practices
• Contribute to prompt experimentation and A/B testing infrastructure to validate improvements
• Partner with senior platform engineers and architects to learn and contribute to platform development
• Collaborate with data engineers to ensure seamless integration between data and AI platforms
• Work with cross-functional teams to support model operationalization and scaling
• Contribute to technical documentation and knowledge sharing
• Support the adoption of enterprise AI platform tools and accelerators across business teams
• Participate in code reviews and follow engineering best practices
• Support AI platform delivery with contractor and consultant teams under guidance from senior team members
• Contribute to knowledge-sharing sessions and workshops to build platform awareness across teams
• Document best practices, lessons learned, and technical standards for AI platform development
• Stay current with industry trends in AI platforms, MLOps, LLMOps, and cloud AI services
• Share insights and learnings with the broader team to foster continuous improvement
• Assist in evaluating emerging AI technologies, frameworks, and tools for potential platform integration
• Identify opportunities to enhance platform capabilities based on business feedback
• Contribute to the evolution of best practices and standards for AI platform development
• Other duties as assigned

Benefits

• The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level