Software Engineer III - LLM

JPMorgan Chase & Co.•Wilmington, DE

About The Position

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. Serve as an emerging member of an agile team to design and deliver market-leading technology products in a secure and scalable way. Join an agile Corporate Technology team at JPMorganChase to design AI‑enabled platforms with modern Python services on AWS, integrating LLMs and agentic patterns to solve real enterprise problems. Work with advanced technologies, ship to production at scale, and drive resiliency and security across mission‑critical systems. As a Software Engineer III with JPMorganChase within the Corporate Sector – AIML Data Platforms LLM Team, you will play a crucial role in the LLM Suite, tackling some of the most pressing challenges in the financial services sector to create meaningful impact for the organization. Your responsibilities will include transforming early-stage code into production-ready solutions and contributing to the continuous improvement of our technology platforms.

Requirements

Formal training or certification in software engineering concepts with 3+ years of applied experience
Hands-on experience in system design, application development, testing, and operational stability
Proficiency in Python (FastAPI), Microservices, APIs, LLMs, and AWS services (EC2, ECS, EKS, Lambda, SQS, SNS, RDS Aurora MySQL & Postgres, DynamoDB, EMR, Kinesis)
Experience developing, debugging, and maintaining code in a large corporate environment using modern programming and database querying languages
Strong understanding of the Software Development Life Cycle
Solid grasp of agile methodologies including CI/CD, Application Resiliency, and Security
Knowledge of cloud, AI, ML, and mobile technologies. Experience with agent-to-agent communication, Model Context Protocol (MCP), AI skills, personal AI assistants, agentic orchestrators, AI coding assistants (e.g., GitHub Copilot), and spec-driven frameworks (Speckit, BMAD)

Nice To Haves

Familiarity with modern front-end technologies
Exposure to cloud technologies
Background in machine learning, deep learning, and neural networks
Experience with state-of-the-art GenAI services leveraging Azure OpenAI models and AWS Bedrock

Responsibilities

Designs, develops, and troubleshoots software solutions with a creative mindset, going beyond conventional approaches to solve complex technical challenges
Writes secure, high-quality production code and maintain algorithms that integrate seamlessly with existing systems
Creates architecture and design artifacts for complex applications, ensuring all design constraints are met throughout the development process
Analyzes and synthesize large, diverse data sets to develop visualizations and reports that drive continuous improvement of applications and systems
Builds innovative AI/ML solutions and agentic systems for the LLM Suite platform using public cloud architecture (Azure, AWS) and modern AI Agentic frameworks
Implements cutting-edge GenAI services leveraging Azure OpenAI models and AWS Bedrock
Identifies hidden problems and patterns in data proactively, using insights to improve coding standards and system architecture
Participates in software engineering communities of practice and events focused on emerging technologies
Fosters a team culture built on opportunity, collaboration, and respect