AI in banking

What 120+ bank deployments reveal about AI governance failure

27 May 2026
10
mins read

Most banks treat AI governance as something you add after the model goes live. That instinct is expensive. Retrofitting governance onto a fragmented AI estate creates compliance gaps, slows deployment, and puts regulators on notice, and the window to get this right is closing fast.

What is an AI governance framework for banking?

Governance and compliance are related, but they're not the same thing. Governance is the architecture - the mechanism that enforces what every model and agent is authorized to do, in real time, as decisions run. Compliance is the outcome that architecture has to produce: proof, on demand, that every decision satisfied the regulatory requirement in force at the time. Get governance right and compliance follows as a byproduct. Treat compliance as the goal without building the governance mechanism underneath it, and you end up assembling evidence after the fact instead of generating it automatically. For the regulatory-outcome side of this argument, see our AI compliance frameworks guide.

The governance problem is structural, not a matter of policy

Banks have been deploying AI for years. Fraud detection, credit scoring, dispute triage, onboarding decisioning - the use cases are real, the budgets are committed, and the pressure to scale hasn't let up. What hasn't kept pace is the governance underneath. McKinsey's 2026 AI Trust Maturity Survey found that only one-third of organizations report mature governance levels in strategy, governance, and agentic AI controls. This is despite financial services leading other sectors on AI adoption overall.

The instinct in most banks is to treat governance as a layer you apply at the end: train the model, run a validation pass, write a policy memo, ship it. That sequence is wrong. Governance applied after the fact creates two problems. First, it can't travel with the model across systems, channels, and agents. Second, it can't scale, every new use case re-pays the same integration and documentation cost from scratch.

The banks that are moving AI into production at scale have figured out that AI data strategy and governance are the same problem. Governance requires traceability, and traceability requires a unified data foundation. Governance built into the architecture enforces itself; governance bolted on afterward doesn't.

Where AI governance actually applies in banking

Governance isn't abstract. It applies to five domains where AI already makes decisions that affect real customers.

Fraud detection models flag transactions in real time. A wrong call costs money, either through fraud that slips through or a legitimate payment that gets blocked. Credit decisioning models score loan applications and approve or deny them in seconds. A biased model here doesn't just create risk. It creates discrimination that regulators actively look for.

AML and KYC programs use AI to scan for money laundering risk and verify identities during onboarding. Customer servicing increasingly runs through Conversational Banking. It handles requests like balance inquiries and payment scheduling before a human gets involved. Underwriting models in lending and insurance predict default and claims risk, then price accordingly.

Every one of these domains touches sensitive data. Every one makes decisions that affect someone's financial life. Every one needs the governance framework that follows.

What a rigorous AI governance framework covers

An AI governance framework for banking isn't a single document or a single team. It's a set of interlocking controls that cover the full lifecycle of every model the bank deploys, from design through retirement. The pillars that matter most are model risk management, explainability, bias auditing, data lineage, and regulatory alignment.

Model risk management

Traditional model risk management (MRM) was built for statistical models with narrow, well-defined inputs. Generative AI and agentic systems break most of those assumptions. Inputs are dynamic, outputs are probabilistic, and the model's behavior can drift as it processes new data. Banks need MRM standards that reflect gen-AI-specific risks, multistep interactions, changing input distributions, and the compounding uncertainty of agentic chains where one model's output becomes another's input.

A production-ready MRM program for 2026 covers model inventory and version control, pre-deployment validation including bias and fairness testing, and continuous monitoring for drift and performance degradation. It also requires a defined escalation path when a model behaves outside its validated range. The agentic AI strategy at the most advanced banks now extends MRM to cover multi-agent systems. In these systems, the risk isn't just individual model failure but emergent behavior across a chain of agents acting autonomously.

Explainability requirements

Explainability is non-negotiable in banking. When an AI system influences a credit decision, a fraud flag, or a customer outcome subject to fair lending law, the bank must be able to reconstruct exactly how that decision was reached. This means knowing what data was used, what model version produced the output, and what policy governed the action. Regulators are specific on this. The OCC, Federal Reserve, and CFPB have consistently held that explainability is a compliance requirement, not an architectural preference. This applies particularly to consumer-facing credit decisions.

The practical implication is that explainability can't be an afterthought. It has to be captured at the moment of decision, not reconstructed from logs afterward. Every action, by every actor - human, automated workflow, or AI agent - needs a traceable evidence bundle that survives audit scrutiny.

Bias auditing

Bias in AI models isn't hypothetical in banking - it's a regulatory exposure. Credit models trained on historically biased data reproduce those biases at scale. Fraud models that overweight certain behavioral signals can produce discriminatory outcomes. Bias auditing requires pre-deployment testing across protected characteristics, ongoing monitoring after deployment, and documented remediation when disparate impact is detected. It also requires that the bank can demonstrate this process to regulators on demand - not after an enforcement action.

Data lineage

An AI model is only as trustworthy as the data it was trained on. Data lineage means the bank can trace every input - where it came from, when it was captured, how it was transformed, and what version of it was used to train which model version. Without lineage, you can't validate models properly, you can't respond to regulatory inquiries, and you can't detect when a data source has degraded in quality. Building a sound AI data strategy is the prerequisite, not a parallel workstream.

Building the framework in four steps

Most banks don't fail at governance because they lack policy. They fail because they never built the framework as a repeatable process. Four steps make it repeatable.

Inventory. Catalog every AI system the bank runs. This includes systems built internally, vendor-bought systems, and generative AI tools used without formal approval. For each one, document its purpose, its data inputs, the actions it triggers, and who owns it. This inventory becomes the system of record regulators will ask for.

Classify. Not every model needs the same oversight. Sort systems into risk tiers. Credit decisioning and fraud blocks sit in the highest tier and need strict controls before deployment. Lead scoring and similar systems sit in the middle. Internal operational tools with minimal customer impact need basic documentation only.

Control. Vendor-built models carry the same accountability as models built in-house. Before deploying any third-party AI, require model documentation and explainability artifacts. Ask for performance metrics across customer segments and a clear update process. Build these requirements into the contract, not a side conversation.

Monitor. Deployment is the start, not the finish. Set automated drift detection with thresholds that trigger human review. Schedule review cadences by risk tier: monthly for high-risk systems, quarterly for medium, annually for low. Document every review and every change.

Regulatory alignment: EU AI Act, OCC guidance, MAS FEAT, and US enforcement

The regulatory landscape for AI in banking has converged on a few consistent themes, even if the specific frameworks differ by jurisdiction. The EU AI Act classifies credit scoring and risk assessment as high-risk AI systems. It requires conformity assessments, technical documentation, human oversight mechanisms, and post-market monitoring before deployment. DORA adds operational resilience requirements that apply to AI systems as critical ICT components.

The OCC's guidance reinforces that model risk management applies to AI. Banks must maintain documentation sufficient to support supervisory examination. The Monetary Authority of Singapore's FEAT principles - Fairness, Ethics, Accountability, and Transparency - establish a principles-based framework that has influenced governance thinking across Asia-Pacific. Deloitte's 2026 analysis of agentic AI risks in banking notes that extending governance frameworks to cover autonomous AI agents requires new risk roles, new oversight mechanisms, and explicit authority boundaries for every agent the bank deploys.

The U.S. Treasury's Financial Services AI Risk Management Framework, built on NIST foundations, adds a shared governance vocabulary and a common control architecture. Banks of all sizes can use it to evaluate and manage AI use cases from fraud detection to customer servicing. Banks operating across jurisdictions need a framework architecture flexible enough to satisfy all of these simultaneously. This means principles-based controls that can be configured to local regulatory requirements, not jurisdiction-specific policy documents that create governance silos. The World Economic Forum's responsible AI playbook for banks outlines how principles-based governance can be structured to span multiple regulatory regimes simultaneously.

US enforcement adds another layer banks can't treat as optional. The SEC monitors AI used in trading and investment advice. It expects the same oversight a bank would apply to a human advisor. FINRA focuses on broker-dealer applications and wants documented testing, validation, and ongoing monitoring. The OCC and Federal Reserve enforce model risk management under SR 11-7. That standard applies directly to AI models making credit and risk decisions. The CFPB watches for consumer harm specifically. Fair lending laws like ECOA and HMDA apply to AI credit decisions regardless of intent. An unintentionally discriminatory model is still a violation.

A practical governance checklist for banking AI

Before any AI model reaches production in a bank, the governance checklist should confirm the following. The model inventory is updated with version, owner, domain, and risk classification. A pre-deployment validation report covers accuracy, bias testing across protected characteristics, and adversarial robustness. Explainability documentation is in place - including which features drove the decision and how the output maps to the policy that authorized it. Data lineage is recorded for every training dataset used. A post-deployment monitoring plan is active with drift thresholds and escalation triggers. Human oversight controls are defined for every decision that crosses a regulatory or risk threshold. A decision evidence record is generated for every action the model takes in production.

This checklist applies to first-party models, third-party models, and models embedded in vendor platforms. Regulatory accountability doesn't transfer when a bank buys a model from a vendor - it stays with the bank. That's a point worth repeating to every procurement team evaluating AI vendors.

A checklist for CROs and CDOs

The existing checklist covers what to verify before a model launches. CROs and CDOs need a second layer. It checks what's happening after launch, at the point where decisions actually execute.

Confirm every agent operating in a live customer context has a named owner. That owner is accountable for its behavior at runtime, not just at deployment. Confirm Decision Token coverage is complete. Every agent action should carry one. Any action that doesn't is an unaudited decision path waiting for a regulator to find it. Confirm explainability holds up under pressure. Every decision that affects a customer outcome should produce a human-readable rationale on demand. It shouldn't be a log file that needs a data scientist to interpret. Confirm bias monitoring runs on the same cadence as drift checks, not as a separate annual exercise.

If any answer requires pulling logs from multiple systems to reconstruct what happened, the governance isn't there yet. It's still living in a policy document.

The four-question test

Every checklist above compresses into four questions. If your team can't answer all four for a given model in seconds, not hours, not after pulling logs from three systems, the governance isn't built yet, it's still a policy document waiting to be enforced.

  1. What does it do?
  2. Who authorized it?
  3. How did it decide?
  4. Can you turn it off?

Run this test model by model, quarterly, alongside the CRO and CDO checklist above. A model that fails the four-question test belongs back in the classification step until the gap is closed.

Why governance-by-design requires the right architecture

This is not a hypothetical gap. Jouk Pleiter has described the physical reality of this bluntly. Banks have had to add a third monitor to customer operations desks. The systems needed to resolve one case don't fit on two screens. That is not a process failure. That is an infrastructure failure wearing a governance costume.

A policy written in a boardroom doesn't know what an agent is doing at 2am when no reviewer is watching. Only architecture enforces a rule at the moment the decision happens, regardless of who's awake to check it.

Here's where most AI governance frameworks fail: they're designed as policies applied to models, not as capabilities embedded in the execution layer. Policy documents don't travel with models. They don't enforce themselves at runtime. They don't generate the evidence records regulators require. They require humans to check compliance manually, and at the volume and velocity that agentic AI operates, manual checks don't scale.

Governance by design means the enforcement layer sits inside the system that executes banking decisions, not beside it. Every action, by a customer, an employee, or an AI agent, is evaluated against the governing policy before it executes. The evidence record is created automatically. The audit trail is complete without human intervention.

Autonomy levels are configured, measured, and revocable at any time, and they scale in three stages:

  • Assistive. The human leads. The model supports with recommendations, drafts, and flagged exceptions, but every action still requires a human hand.
  • Delegated. The model acts within defined limits. A human approves before the action executes, or reviews it immediately after, depending on the risk tier.
  • Autonomous. The model acts within its authorized boundary. A human monitors the pattern of decisions rather than approving each one, and can revoke the authority instantly if the pattern drifts.

Each transition between levels needs evidence the system is ready, not a policy sign-off. A model doesn't move from assistive to autonomous because a committee approved a roadmap. It moves because the Decision Token record proves it has operated inside its boundary long enough, at enough volume, to earn the wider mandate.

This is the structural argument for an AI-native banking operating system. Retrofitting governance onto a fragmented estate isn't governance, it's documentation theater. The banks that will pass regulatory scrutiny at agentic scale are the ones that built the control plane first.

Across 120+ bank deployments, the pattern is consistent. Banks that hit AI implementation failures at scale almost always trace them back to the same root cause: governance was a process layered on top of an architecture that couldn't enforce it. The model registry existed, but models ran outside it. The bias testing happened, but the results didn't feed back into the deployment pipeline. The explainability requirement was documented, but the decision evidence wasn't captured at runtime.

The AI-native Banking OS addresses this by making governance a first-class capability of the execution layer. Sentinel, the Authority Layer, runs alongside every layer of the Banking OS stack. No action executes without a Decision Token. Every Decision Token records the policy applied, the actor identity, the model version, and the full decision context. The Model Registry inside the Intelligence Layer tracks every deployed model with version control and approval workflows. Drift detection and bias monitoring run continuously in production. EU AI Act compliance is built into the execution pipeline, not appended to it.

Governance as infrastructure means the enforcement layer runs with the execution layer, not beside it. This is the same way banks treat identity and access management as infrastructure rather than as an annual policy review. AI-native banking means the governance layer is load-bearing, not decorative.

What governance requires in practice: five properties

Across more than 120 bank implementations, five properties consistently separate the frameworks that hold up under regulatory scrutiny. The rest don't.

A shared semantic foundation. Every agent, every workflow, and every employee workspace needs to operate from the same source of truth about the customer. Nexus, the Semantic Layer in the Banking OS, provides this through the Customer State Graph. It replaces the fragmented data scattered across dozens of systems.

Authorized decision boundaries for every agent. Banks need to define what each AI agent is entitled to do, under what authority, and with what limits. That definition has to exist before the agent ever acts.

Deterministic orchestration for known processes. Not every banking workflow should run on agentic reasoning. Known, repeatable processes belong in deterministic workflows. Reserving agentic execution for the tasks that actually need judgment reduces coordination overhead. That overhead is exactly where non-compliant workarounds tend to show up.

Continuous auditability, not periodic reporting. Decision Tokens turn governance from a reporting exercise into an operational record that exists the moment a decision runs.

Parallel build, not sequential. Valbona Dhjaku, a technology and digitalization leader with twenty years at Credins Bank, put it directly. Banks have to build core systems, data foundations, governance, and security at the same time, not one after another. Waiting for a fully formed framework before deploying the first domain doesn't make sense. It just delays the value each new deployment compounds.

The three-lines model still applies - but the lines need rewiring

Banks running on traditional three-lines-of-defense governance frameworks will find that the model fits AI - but the roles within each line need updating. The first line owns model performance in production, including drift monitoring and bias reporting. The second line owns the governance framework itself - the policy standards, the risk appetite, the MRM methodology. It now needs quantitative AI risk expertise, not just qualitative review skills. The third line audits whether the first two lines are functioning. This requires audit teams that can read model documentation, interpret explainability outputs, and assess whether the decision evidence is complete.

The emerging role of Chief AI Officer, or CAIO, is the executive who owns the enterprise AI strategy. This role ensures the governance framework is funded, enforced, and visible to the board. Banks without this role are increasingly exposed - regulators in multiple jurisdictions are asking who owns AI risk at the executive level. "It's distributed across the CTO and the risk function" is not a satisfying answer.

As McKinsey's analysis of gen AI governance in financial institutions makes clear, MRM committees need to continuously adapt their standards to reflect how models handle changing inputs and multistep interactions. Updating them annually is not sufficient. The cadence of AI risk is faster than the cadence of traditional model validation cycles.

Where this industry is heading is consistent with what we see across more than 120 bank implementations: governance that runs at the speed of AI, enforced by the architecture rather than by the policy team. Banks that invest in the execution layer now - the control plane, the model registry, the decision evidence infrastructure - will find that regulatory scrutiny becomes a competitive advantage rather than a compliance cost. Banks that don't will spend the next three years explaining to regulators why their AI governance framework is a document rather than a system. The agentic banking use cases that deliver real ROI are the ones where governance is embedded in the workflow - not reviewed after the fact.

Frequently asked questions

Why do banks need a dedicated AI governance framework?

Banks operate in a regulated environment where AI decisions can directly affect consumer rights, credit access, and financial stability. Regulators across the OCC, EU AI Act, and MAS FEAT frameworks require banks to demonstrate that AI models are fair, traceable, and under human oversight. Without a dedicated AI governance framework for banking, institutions risk enforcement action, model failures at scale, and reputational damage from biased or opaque decisions.

How does the EU AI Act affect AI governance in banks?

The EU AI Act classifies credit scoring, fraud detection, and risk assessment as high-risk AI systems. Banks must complete conformity assessments, maintain technical documentation, and implement human oversight mechanisms before deploying these systems. Post-market monitoring is mandatory, and banks must be able to demonstrate compliance to supervisory authorities on demand. This makes runtime governance infrastructure, not just policy documents, essential.

What is model risk management in the context of banking AI?

Model risk management (MRM) for banking AI covers the full lifecycle of every AI model - from inventory and pre-deployment validation through continuous drift monitoring and retirement. It requires bias testing across protected characteristics, version control, explainability documentation, and escalation protocols when a model behaves outside its validated range. For agentic AI, MRM must extend to cover multi-agent chains where outputs from one model feed the next.

How can banks embed AI governance by design rather than retrofitting it?

Governance by design means enforcement sits inside the execution layer, not alongside it as a separate policy process. An AI-native banking operating system like the Backbase Banking OS embeds governance through Sentinel, an Authority Layer that requires a Decision Token before any action executes. This captures the policy applied, model version, and full decision context automatically, so every AI action is auditable without manual intervention.

Who owns AI governance inside a bank?

Ownership is shared. The board sets risk appetite. A CAIO or CIO owns the framework. Risk, compliance, and the business units running AI in production own execution day to day.

Does AI governance slow down innovation?

A well-designed framework speeds things up. Teams stop reinventing approval processes for every new model. Pre-approved patterns and clear decision authority let teams ship faster with confidence.

What is the difference between AI governance and AI compliance in banking operations?

Compliance means meeting documented regulatory requirements. Governance means enforcing those requirements at the moment a decision runs. Most banks have compliance covered on paper. Few have governance built into runtime.

What are the three autonomy levels an AI governance framework must account for?

Assistive, where the human leads and the model only supports; delegated, where the model acts within limits and a human approves; and autonomous, where the model acts within its authorized boundary and a human monitors the pattern rather than approving each action. Each level requires its own controls, and moving a model up a level requires evidence from its Decision Token history, not just a policy sign-off.

About the author
Table of contents
Vietnam's AI moment is here
From digital access to the AI "factory"
The missing nervous system: data that can keep up with AI
CLV as the north star metric
Augmented, not automated: keeping humans in the loop