BCG Platinion | Senior AI Solution Architect

Boston Consulting Group•Durham, NC

11d

About The Position

BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale. Senior AI Solution Architects at BCG Platinion are: Collaborative. They work closely with business stakeholders, product owners, engineers, and data scientists to deliver AI-enabled solutions that address specific functional challenges. Business - Oriented Problem Solvers. They contribute to the design and implementation of AI-driven solutions tailored to defined use cases (e.g., customer service automation, financial analysis, operations optimization). Hands-on Technologists. They apply strong AI and software engineering skills to build, test, and refine AI-powered workflows and applications. Comfortable with ambiguity. They adapt effectively as business requirments evolve, helping clarify use cases and refine solution approaches. Delivery-focused Contributors. They support implementation, integration, and adoption of AI solutions within existing business processes and systems. Agile Practitioners. They work within iterative delivery cycles, testing and improving AI-enabled solutions based on feedback and measurable outcomes. Innovative. They apply modern AI paterns, including LLMs and agentic workflows, to enhance business processes and user experiences. Developing Solution Architects. They grow their solution design capabilities through hands-on delivery and exposure to broader architectural decisions. Reliable team members. They execute defined workstreams and contribute to high-quality AI solution implementations under the guidance of senior architects. We are seeking a Senior AI Solution Architect to support the design and implementation of AI-enabled business solutions powered by LLMs and agentic systems. This role is ideal for someone who enjoys hands-on development while building expertise in translating functional requirements into scalable AI applications. You will work with business and technical teams to implement intelligent solutions that integrate LLMs, enterprise systems, and domain workflows.

Requirements

Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
4+ years of experience in software engineering, data engineering, or AI-enabled system development.
Hands-on experience building or integrating AI/ML or LLM-based components within business solutions.
Solid understanding of business workflows and functional use cases within at least one domain or industry.
Proficiency in one or more programming languages such as Python or JavaScript is good to have.
Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI solution components.
Familiarity with modern AI frameworks and libraries (e.g., LangGraph, LangChain, LlamaIndex, Semantic Kernel, or similar).
Working understanding of RAG, MCP, prompt orchestration, vector databases, and agent-based solution components.
Basic understanding of API integration and enterprise system connectivity.
Exposure to deploying AI solutions within cloud environments (AWS, Azure, or GCP).
Strong problem-solving skills and attention to quality and usability.
Ability to explain technical concepts clearly within a project team and to functional stakeholders.
Willingness to learn and grow in fast-paced, ambiguous consulting environments.
Agile mindset with focus on delivering measurable business value.
Willingness to travel to work with clients and BCG teams as needed.
Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Responsibilities

Contribute to the design of AI-enabled solutions aligned to defined business use cases and functional requirements.
Implement AI-driven workflows leveraging LLMs, agentic patterns, and structured/unstructured data sources.
Build and extend RAG-based components to support contextual reasoning and knowledge retrieval.
Support integration of AI solutions with enterprise systems, APIs, and operational tools.
Follow established design principles and contribute feedback to improve solution patterns and implementation standards.
Assist in balancing solution usability, performance, and cost considerations.
Develop solution prototypes and technical proofs of concept to validate business use cases.
Experiment with prompts, retrieval strategies, and orchestration logic to improve functional outcomes.
Work closely with engineers and solution leads to refine feasibility and technical design decisions.
Support deployment of AI solutions into development and production environments.
Assist with testing, validation, and performance evaluation of AI-enabled workflows.
Contribute to monitoring, troubleshooting, and continuous improvement of implemented solutions.
Follow defined standards for versioning, documentation, and model lifecycle management.
Communicate technical solution details clearly within project teams and with immediate stakeholders.
Support preparation of documentation, solution summaries, and implementation materials.
Collaborate closely with business users and technical teams to ensure solution alignment and usability.
Participate in design workshops and working sessions, contributing implementation insights and recommendations.
Incorporate feedback from senior team members to continuously improve technical output.
Support junior team members through knowledge sharing and collaborative delivery.
Contribute positively to team culture and ways of working.
Seek and apply feedback to strengthen solution design and implementation quality.
Demonstrate professionalism and alignment with BCG’s culture and client-first values.
Stay current on emerging AI solution patterns across industries and functional domains.
Experiment with new AI tools and techniques to expand solution design capabilities.
Build depth in AI-enabled business solution delivery through hands-on experience.
Actively pursue learning opportunities to grow toward broader solution architecture responsibilities.
Contribute technical input to proposals or internal initiatives when appropriate.

Benefits

An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
$10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
Vision insurance with coverage for both glasses and contact lenses annually.
Reimbursement for gym memberships and other fitness activities.
Fully vested retirement contributions made annually, whether you contribute or not.
Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.