Software Engineer III - LLM Suite Engineering - Senior Associate

Job Description

Help shape how intelligent systems are built and delivered at JPMorganChase. In this role, you’ll contribute to the LLM Suite platform by building AI/ML and agentic capabilities that are secure, reliable, and ready for production. You’ll collaborate closely with senior engineers, learn through real design discussions, and grow your technical depth across cloud and modern AI frameworks. If you enjoy solving tough problems and iterating quickly with feedback, you’ll fit right in. 

As a Software Engineer, Senior Associate, in the LLM Suite Engineering team, you will design, build, and troubleshoot software that enables AI/ML and agentic experiences on the platform. You will write secure, high-quality code and support algorithms that integrate with existing systems. You will collaborate with senior engineers on designs and implementation choices, focusing on reliability and operational stability. You will help deliver GenAI services using public cloud capabilities. You will explore and operationalize emerging patterns such as agent-to-agent communication, model context protocols, and agentic orchestration, turning early-stage concepts into scalable, production-ready capabilities. You will contribute as a team player who seeks and applies feedback.

 

Job Responsibilities

• Design, develop, and troubleshoot software solutions using creative approaches to solve complex technical challenges
• Write secure, high-quality production code and maintain algorithms that integrate with existing systems
• Collaborate with senior engineers and participate in design discussions
• Build AI/ML solutions and agentic systems for the LLM Suite platform using public cloud architecture (Azure, AWS) and modern agentic frameworks
• Implement GenAI services leveraging Azure OpenAI models and AWS Bedrock
• Collaborate openly with the team, seek feedback, and apply it to improve outcomes

 

Required Qualifications, Capabilities, and Skills

• Computer science degree or equivalent practical experience
• Hands-on experience with system design, application development, testing, and operational stability
• Strong understanding of the Software Development Life Cycle

 

Preferred Qualifications, Capabilities, and Skills

• Experience implementing GenAI services leveraging Azure OpenAI models and AWS Bedrock
• Proficiency in Python (FastAPI)
• Experience building microservices and APIs
• Experience with elastic compute, NoSQL databases, and messaging queues
• Proficiency working with large language models and building agents with LangGraph
• Experience developing, debugging, and maintaining code in a large corporate environment using modern programming and database querying languages, including containerization
• Knowledge of agent-to-agent (A2A) communication, Model Context Protocol (MCP), AI skills development, personal AI assistants, or agentic orchestrators
  #LLMSuiteEngineering_jobs

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our  FAQs for more information about requesting an accommodation.

About the Team

Our Corporate Technology team relies on smart, driven people like you to develop applications and provide tech support for all our corporate functions across our network. Your efforts will touch lives all over the financial spectrum and across all our divisions: Global Finance, Corporate Treasury, Risk Management, Human Resources, Compliance, Legal, and within the Corporate Administrative Office. You’ll be part of a team specifically built to meet and exceed our evolving technology needs, as well as our technology controls agenda.