BCG Platinion | Lead IT Architect - AI Platforms

Boston Consulting Group•Durham, NC

19h

About The Position

Boston Consulting Group (BCG) is a global consulting firm that partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Our success depends on a spirit of deep collaboration and a global community of diverse individuals determined to make the world and each other better every day. BCG's Tech and Digital Advantage (TDA) practice focuses on helping clients deliver competitive advantage and business superior performance through data, technology and digital. BCG Platinion sits within the TDA practice and is at the heart of the strategic impact we have with our clients. Our consultants and experts globally work across all industries and provide deep experience and expertise in a wide variety of topics including Digital Transformation, Data & Digital Platforms, AI at Scale, Cybersecurity and Digitizing the Tech Function. At BCG, we bring together the right people to conquer complexity, drive material change, and initiate positive, long-term impact. Explore our BCG Culture and Values for more information. BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale. We are seeking a Lead AI Platform Architect to design and guide the implementation of intelligent, agentic AI platforms. This role bridges platform architecture and hands-on technical leadership, ideal for someone who can design end-to-end AI platform solutions while remaining close to implementation through prototyping and architectural validation. You will work across AI, data, product, and engineering teams to define and deliver scalable AI architectures that integrate large language models (LLMs), data pipelines, and enterprise systems.

Requirements

Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
6+ years of experience in software engineering, data engineering, or AI systems with experience in architecture or technical leadership roles.
Strong foundation in software architecture and distributed systems.
Experience designing AI/ML or LLM-based systems in production or near-production environments.
Understanding of Cloud architecture, data platforms, and API-based system integration, with depth in at least one hyperscaler (AWS, Azure, or GCP).
Experience of deploying AI solutions on cloud AI platforms and services
Integration of AI workflow with enterprise systems and data sources
Exposure to containerization and orchestration technologies (Docker, Kubernetes)
Strong analytical thinking, problem-solving skills, and attention to engineering quality.
Ability to explain technical concepts clearly to senior technical and non-technical stakeholders.
Consulting mindset with comfort operating in ambiguous, fast-paced environments.
Agile mindset with a focus on delivering business value through modern AI platforms.
Willingness to travel to work with clients and BCG teams as needed.
Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Nice To Haves

Master’s degree is a plus
Proficiency in one or more programming languages (e.g., Python, Javascript, TypeScript) is nice to have.
Experience using modern AI-assisted coding and development tools (e.g., Cursor, Claude Code, Replit, Lovable) to accelerate prototyping experimentation, and implementation of AI platform solutions.
Familiarity with modern AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex, etc.).
Working knowledge of agentic AI concepts including RAG, multi-agent orchestration, memory patterns, vector databases, and function-calling.
Experience with AI developer tools and productivity accelerators is a plus.
Familiarity with vector databases and retrieval patterns; exposure to Pinecone, Qdrant, Aure Search, or similar is beneficial.

Responsibilities

Design system architectures for AI and LLM-based solutions, balancing scalability, performance, modularity, and operational complexity.
Evaluate emerging Ai frameworks and tooling (e.g., LangChain, LlamaIndez, LangGraph, Strands, Google ADK, Semantic Kernel, etc.) and recommend fit-for-purpose usage.
Design agentic AI solutions to enable intelligent workflow automation, including task decomposition, memory usage, and orchestration patterns.
Define AI integration patterns such as RAG for context management, model orchestration, prompt workflows, and enterprise system connectivity.
Contribute to architectural standards and design principles for model lifecycle management, data lineage, and responsible AI practices.
Support architecture decisions for hybrid pipelines (batch training, real-time inference) with consideration for cost, latency, and operational risk.
Develop proof-of-concepts and architectural prototypes to validate AI platform designs, RAG flows, and agent orchestration patterns.
Support implementation of agentic workflows using modern orchestration and automation platforms in collaboration with engineering teams.
Support teams and clients as AI platforms transition from prototype to production environments.
Contribute to system performance, observability, and governance approaches as solutions scale.
Help define development standards for versioning, testing, deployment, and monitoring of AI services and models (LLMOps).
Translate complex AI platform concepts into clear narratives for both technical and non-technical stakeholders.
Deliver structured presentations, lead technical discussions, and support client decision-making.
Collaborate closely with product managers, data scientists, and engineers to align architecture with business objectives.
Facilitate technical working sessions and design workshops, providing architectural guidance and hands-on mentorship.
Provide direction and constructive feedback on key technical work items across teams.
Support and guide junior team members by helping structure their work and technical approach.
Mentor junior architects and technology consultants through ongoing feedback and development conversations.
Provide quality assurance by reviewing outputs for technical correctness, clarity, and architectural alignment.
Contribute to a positive team environment and model BCG’s culture and values.
Stay current on emerging techniques in agentic AI, RAG architectures, retrieval strategies, and AI platform patterns.
Contribute ideas that improve AI platform architectures, delivery approaches, and client outcomes.
Develop depth as a go-to expert in AI platform and agentic system design within project teams.
Continuously build skills and technical breadth to increase impact over time.
Support business development through technical input, architecture sections of proposals, and solution shaping.
Build strong working relationships with client counterparts and internal stakeholders.

Benefits

An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
$10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
Vision insurance with coverage for both glasses and contact lenses annually.
Reimbursement for gym memberships and other fitness activities.
Fully vested retirement contributions made annually, whether you contribute or not.
Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.