Building an Agentic Enterprise  ·  Chapter 16 of 21
Chapter 16

JPMorgan: LLM Suite and the Compliance-First Path

What 230,000 internal users teaches about the right pace in a regulated firm

230,000
employees with access to JPMorgan's LLM Suite
4yrs
consecutive years topping Evident's AI Index
1Grand Prize
American Banker Innovation of the Year 2025
Save PDF

JPMorgan's enterprise AI program looks slow from outside and is the fastest-compounding deployment in financial services. Its central artefact, the LLM Suite, is the most-used internal generative AI platform on the planet by employee count. The lesson is the order of operations.

What they shipped

JPMorgan Chase deployed its LLM Suite — an internal generative AI platform providing secure access to advanced large language models from multiple providers — to over 230,000 employees globally, for legal, sales, and client service operations. The platform was developed in-house, operates within a tightly controlled environment that prioritises data protection and regulatory compliance, and earned American Banker's 2025 Innovation of the Year Grand Prize. JPMorgan has topped Evident's AI Index for four consecutive years.

What the LLM Suite is not: a customer-facing agent. It is a productivity platform — an internal Copilot at industrial scale — and the careful framing matters. JPMorgan has chosen, at every observable step, to deploy AI to the people who already work for the firm before deploying AI on behalf of the firm to people who do not. That sequence is the core of the lesson.

What was already there

The LLM Suite did not arrive in an organisation that had no AI. JPMorgan's COIN (Contract Intelligence) system, deployed in 2017, was one of the first large-scale enterprise machine-learning deployments in finance — automating review of commercial loan agreements that previously consumed 360,000 man-hours a year. IndexGPT, in 2023, was a different product targeting thematic securities baskets. These are different generations of technology and different use cases. They are also a decade of institutional muscle: the data infrastructure, the legal patterns, the change-management practices, and (most importantly) the relationship with regulators that you cannot stand up in eighteen months.

The LLM Suite is, in this sense, the third or fourth wave of AI at JPMorgan, not the first. Reading the deployment without that history is the most common mistake outsiders make. They see the speed and the scale of LLM Suite without seeing the runway it was built on.

What the broader market should note

JPMorgan's posture reflects what works in heavily regulated environments. Build or customise rather than using off-the-shelf tools with opaque data handling. Maintain complete data lineage. Deploy to internal productivity before customer-facing use cases. Invest in in-house AI infrastructure and talent rather than outsourcing the core. Engage regulators early. Move at compliance-pace, not vendor-pace.

The temptation, in any regulated firm, is to argue that this kind of patience is a competitive disadvantage. The Klarna story — fast deploy, fast results, fast headlines — gets deployed as the counter-example. But Klarna is consumer credit; JPMorgan is the centre of the global financial system. The blast radius is not comparable, and the right autonomy tier (Chapter 9), the right HITL design (Chapter 14), and the right compliance posture for one is not the right one for the other.

If your firm is in financial services, healthcare, energy, or any other Annex III high-risk sector under the EU AI Act, JPMorgan's order of operations is the template, not Klarna's. Internal first. Regulator engagement throughout. Production deployment behind a deep set of controls, not in front of them.

Questions to ask

If your firm is regulated, what is the equivalent of LLM Suite in your organisation — the internal productivity platform that gives every employee a way to do their job better with AI, before any AI is exposed to a customer? If the answer is "we are starting with a customer-facing chatbot", you have not earned that right yet. The internal program is the runway.

The cost of patience

Specific production metrics for LLM Suite are not publicly disclosed, which is itself a signal. Regulated firms are appropriately cautious about claims that could be construed as forward-looking statements or that could complicate ongoing supervisory dialogue. The absence of glossy stat-deck numbers is part of why the deployment looks slow from outside. It is also why it is durable.

The cost of this approach is real. JPMorgan was not first to consumer-facing AI in banking. Some smaller institutions and fintechs have shipped customer-facing assistants before JPMorgan would. The risk-adjusted return on patience, however, is the lesson: the firm that has internal infrastructure, governed inventory, regulator engagement, and a workforce that has used the tools for two years before the customer sees one is the firm whose first customer deployment is least likely to become an Air Canada-class incident.

The next chapter is McDonald's, which is — counter-intuitively — also a story about doing it right.

JPMorgan's runway Each generation built the muscle the next required. LLM Suite is wave 3, not wave 1. COIN — 2017 Contract Intelligence commercial loan review 360,000 hrs/yr automated muscle: data lineage muscle: legal patterns muscle: model ops IndexGPT — 2023 thematic baskets first generative product narrow scope muscle: regulator dialogue muscle: prompt patterns muscle: change mgmt LLM Suite — 2024–25 internal generative platform 230,000 employees legal · sales · client svc American Banker IOTY 2025 Evident #1 four years no customer-facing yet The lesson is the order of operations: internal first, regulator early, customer-facing last (and not yet).
Figure 16.1JPMorgan AI runway: COIN (2017) → IndexGPT (2023) → LLM Suite (2024–25 at scale to 230k users). Each generation built the muscle the next required.