As AI systems evolve from tools to autonomous agents, traditional governance frameworks are no longer sufficient. Chris Smigielski argues that the most critical control in modern banking is not technology, but people. AI fluency—beyond basic literacy—enab
“A
well-trained user is the best control.”
That
comment, made by a speaker at CeFPro’s Risk Americas conference last
year, made an impact.
At
the time, the session was mostly debating AI governance frameworks and how to
prevent employees from pasting personally identifiable information (PII) into
the latest AI-powered browsers and generative AI tools.
But
fast forward to today, and the conversation has shifted dramatically. We aren't
just talking about AI assistants anymore, we are talking about AI Agents and
the complexities of Agentic AI governance.
Within
Model Risk and Operational Risk management, a lot of time is spent looking at
frameworks, heat maps, and policy guardrails.
But
as we move into this next frontier, it becomes evident that no matter how
robust our model risk management (MRM) or third-party risk assessments are,
they will fail if our people aren't fluent in the language of AI.
Annual
Training Does Not Build Fluency
In
the banking world, mandatory annual training is common. There are slide decks,
ten-question quizzes, and a green checkmark for the year. That works for
banking basics, but AI is different.
AI
Literacy is knowing what a Large Language Model (LLM) is. AI Fluency, however,
is understanding how an LLM might hallucinate under specific market pressures
or recognizing when an autonomous agent is drifting from its intended goal. To
govern AI effectively, we need the latter.
We
cannot execute a high-level governance strategy if the staff actually
interacting with these tools don't speak the language.
The
Rise of the Agent: The Stakes Are High
We
are transitioning from "Human-in-the-loop" (HITL) as a passive
reviewer toward a reality where AI agents can achieve specific goals by
planning, reasoning, and executing tasks without constant human oversight.
Agents
can use external tools, access databases, and interact with software to
independently perform complex, multi-step workflows. In an Agentic AI
environment, the risks aren't just about data leakage, they are about rogue
agents and cascading failures.
If
our first and second lines are not AI fluent, our HITL may well become a rubber
stamp. A human who doesn’t understand the underlying tool is not a control;
they are a liability.
Building
Blocks of Reliable Governance
Governance
requires a framework, of course. Guardrails might be suggested by the NIST AI
Risk Management Framework or by emerging regulatory expectations, but those
frameworks are just blueprints. The building blocks of the actual structure
include our associates who can evaluate things like:
Ø Capability: What the AI looks like in
practice.
Ø Critical Questioning: Moving from "The AI
said so" to "Why did the model weight this variable so heavily?"
Ø Prompt Engineering: Understanding that the
precision or quality of the output is a direct reflection of the clarity of the
instruction.