White Paper | The AI Risk Map: A Practical Guide to Frameworks, Threats, and AI Lifecycle Risks

White Paper | The AI Risk Map: A Practical Guide to Frameworks, Threats, and AI Lifecycle Risks

Explore AI security frameworks, threat models, and risks across the AI lifecycle. Learn how to identify vulnerabilities, manage AI governance, reduce cyber security risk, and protect data, models, and AI-enabled applications from emerging threats.

White Paper | The AI Risk Map: A Practical Guide to Frameworks, Threats, and AI Lifecycle Risks

The AI Risk Map:

A Practical Guide to Frameworks, Threats,

and AI Lifecycle Risks

Introduction: Navigating the AI Risk Landscape

The risks facing AI systems have evolved dramatically, especially with the rise of generative

AI. What once lived in the world of abstract governance now demands urgent attention from

security teams, product owners, and ML practitioners alike.

Yet as AI systems grow in complexity and capability, the guidance on how to secure them hasn’t

always kept up. A range of frameworks and standards now exist to define how we should

evaluate and mitigate risk, but they vary widely in scope, focus, and relevance to the systems

being built today.

This guide brings clarity to that landscape.

We focus on the frameworks that provide the clearest picture of

today’s AI risk surface, those that are:

Actively maintained

Purpose-built or adapted for LLMs, agents, or multimodal systems

Used by teams building and securing real-world AI applications

w w w . l a k e r a . a i 11

Frameworks This Guide Is Built On

This section introduces the key frameworks that define the current landscape of AI and its

risks. Each one plays a different role: from technical threat modeling to secure development

practices to regulatory guidance. Together, they form the foundation for the risk map we lay

out in the rest of the guide.

MITRE ATLAS

MITRE’s Adversarial Threat Landscape for Artificial-Intelligence Systems is the most

detailed matrix of how AI systems (especially machine learning and AI) are attacked in

practice. Based on the same model as MITRE ATT&CK, ATLAS maps attacker tactics and

techniques across the full AI lifecycle, including model poisoning, evasion, extraction, and

manipulation.

Used throughout this guide as the foundation for understanding

technical threats.

OWASP Top 10 for LLM Applications (2025)

First released in November 2024, this is the most up-to-date, community-vetted list of the

top vulnerabilities affecting LLM-powered applications. It includes risks like prompt

injection, system prompt leakage, excessive agency, and vector-based attacks that arise

from modern practices like Retrieval-Augmented Generation (RAG).

Serves as a frontline reference for anyone deploying LLMs in production

environments.

w w w . l a k e r a . a i 12

https://atlas.mitre.org/ https://genai.owasp.org/resource/owasp-top-10-for-llm-applications-2025/

OWASP LLM Security Verification Standard (LLMSVS)

A newly released verification standard providing concrete security requirements for building

and evaluating LLM-backed systems. Structured across verification layers and control

domains: from model lifecycle and real-time learning to plugin security and anomaly

detection, it supports both development and audit efforts.

Adds practical, testable controls that complement risk-oriented

frameworks like OWASP Top 10 and MITRE ATLAS.

NIST AI Risk Management Framework (NIST AI RMF)

While broader in scope and more governance-oriented, NIST AI RMF offers a structured

approach to responsible AI development and risk management. Its value lies in alignment

with policy, risk categorization, and high-level accountability practices.

Referenced selectively in this guide where governance

intersects with security.

w w w . l a k e r a . a i 13

https://owasp.org/www-project-llm-verification-standard/ https://www.nist.gov/itl/ai-risk-management-framework

EU AI Act (Regulatory Landscape)

The EU AI Act defines risk-based requirements for AI systems, including transparency, data

quality, documentation, and additional obligations for foundation models. Though not a

technical framework, it plays a key role in compliance planning.

Included in this guide to help contextualize regulatory drivers of

AI security work.

These frameworks don’t exist in isolation, they intersect in ways that matter to real-world

AI development and deployment. Throughout the guide, we draw on their strengths to

highlight where risks emerge, how they evolve across the lifecycle, and what practical steps

teams can take to address them.

Whether you’re building, deploying, or securing AI systems, the goal is the same: make the

landscape clearer, the risks more tangible, and the path to mitigation more actionable.

w w w . l a k e r a . a i 14

https://www.europarl.europa.eu/topics/en/article/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence

AI Risk Categories: 
 What Today’s Frameworks Actually Show

Not all AI risks are created equal, and not all frameworks define them the same way.

This section distills the most prominent categories of risk that emerge when you line up

the latest guidance from:

MITRE ATLAS (latest release: 14 tactics, 100+ techniques)

OWASP Top 10 for LLM Applications (2025): the most current view of LLM

vulnerabilities in practice

Selected references to NIST AI RMF and the EU AI Act, where policy meets security

These seven categories reflect how adversaries exploit AI systems, where the systems

themselves fail, and where responsibility often falls through the cracks.

w w w . l a k e r a . a i 15

Adversarial Manipulation

Attacks designed to subvert or deceive the model, whether through inputs, poisoned data, or

control over its behavior.

Key threats include:

Prompt injection

LLM jailbreaks

Adversarial example crafting

Poisoned training data

Hallucination manipulation (e.g., publishing false RAG entries)

Where this shows up:

MITRE ATLAS: Execution, Defense Evasion, ML Attack Staging

OWASP 2025: LLM01:2025 – Prompt Injection, LLM04:2025 – Data and Model

Poisoning, LLM06:2025 – Excessive Agency

w w w . l a k e r a . a i 16

This is the most technical and actively evolving category of risk—and for good reason.

AI models are increasingly embedded in complex systems, granted access to tools and APIs,

and tasked with autonomous behavior. That means more surface area, more decision points,

and more attack vectors. While safety layers can block obvious misuse, creative prompt

injection and indirect attacks are designed to slip through the cracks.

That’s why Prompt Injection (LLM01:2025) isn’t just first in OWASP’s list, it’s also the

foundation of many real-world breaches, jailbreaks, and misuses.

w w w . l a k e r a . a i 17

Model and Data Leakage

Risks tied to exposing proprietary models, sensitive training data, or hidden system prompts

through normal use or attack.

Key threats include:

Model extraction

Training data leakage

System prompt exposure

Inference-based data reconstruction

Where this shows up:

MITRE ATLAS: ML Model Access, Exfiltration

OWASP 2025: LLM02:2025 – Sensitive Information Disclosure, LLM04:2025 – Data and

Model Poisoning

These are intellectual property and privacy risks, especially critical for companies

training or fine-tuning custom models. Leaked model artifacts or system prompts can

also enable follow-on attacks, serving as a foothold for adversaries to craft more targeted

exploits.

w w w . l a k e r a . a i 18

Misuse and Overreliance

When users or systems place too much trust in AI output, or when applications misuse

models in ways that weren’t intended or safe.

Key threats include:

Blind trust in generated output

Lack of human oversight

Unsafe delegation to agents or plugins

Overly permissive system behavior

Where this shows up:

OWASP 2025: LLM05:2025 – Improper Output Handling, LLM06:2025 – Excessive

Agency, LLM10:2025 – Unbounded Consumption

MITRE ATLAS: Persistence, Privilege Escalation (via plugin abuse)

This is where design flaws meet user behavior, and where security often fails quietly.

w w w . l a k e r a . a i 19

Infrastructure and Access Risks

Technical weaknesses in how AI systems are integrated, hosted, or exposed, especially

around APIs, plugins, or cloud environments.

Key threats include:

Insecure model APIs

Weak access controls

Compromised plugins

Supply chain threats in datasets or libraries

Where this shows up:

MITRE ATLAS: Initial Access, Credential Access, ML Model Access

OWASP 2025: LLM03:2025 – Supply Chain, LLM05:2025 – Improper Output Handling

This connects traditional AppSec and cloud security concerns to the AI stack.

w w w . l a k e r a . a i 11 0

Observability and Response Gaps

Risks that arise when AI systems behave unpredictably, and no one is watching closely

enough to detect or respond.

Key threats include:

Lack of output validation

No logging or monitoring

Inability to detect abnormal usage patterns

Failure to retrain or revalidate over time

Where this shows up:

MITRE ATLAS: Discovery, Impact

OWASP 2025: LLM07:2025 – System Prompt Leakage, LLM10:2025 – Unbounded

Consumption

NIST AI RMF: Continuous monitoring and impact evaluation

These are operational blind spots, often overlooked until it’s too late.

w w w . l a k e r a . a i 11 1

Accountability and Governance Risk

Structural risks from a lack of explainability, documentation, or clarity over who is

responsible for what the AI does.

Key threats include:

No audit trail of system decisions

No model documentation

Gaps in testing, validation, or red teaming

Deployment of unverified models

Where this shows up:

NIST AI RMF, EU AI Act, ISO 42001

OWASP 2025: LLM06:2025 – Excessive Agency, LLM10:2025 – Unbounded

Consumption

MITRE ATLAS: indirectly via ML Attack Staging and Discovery

This is where compliance, safety, and security intersect, especially in enterprise and

regulated environments.

w w w . l a k e r a . a i 11 2

Bias, Harm, and Social Impact

Risks tied to outputs that cause harm to individuals or groups due to bias, toxic content,

misinformation, or unintended use.

Key threats include:

Discriminatory decisions

Toxic or offensive output

Hallucinated legal/medical advice

Misinformation propagation

Where this shows up:

OWASP 2025: LLM04:2025 – Data and Model Poisoning, LLM09:2025 –

Misinformation, LLM10:2025 – Unbounded Consumption

EU AI Act: Prohibitions and transparency for high-risk use cases

NIST AI RMF: Fairness and harm reduction focus

These risks often sit at the intersection of safety, trust, and reputation, and are

increasingly tied to public and legal accountability.

w w w . l a k e r a . a i 11 3

Top 25 AI Risks Mapped

Technique / Risk

Prompt Injection

Data Poisoning

Model Extraction

These 25 risks show up again and again in real-world AI systems. We picked them based on

what comes up most often in leading AI security frameworks like OWASP and MITRE ATLAS,

and what causes the biggest problems if you don’t catch them early.

Definition

Manipulating LLMs via crafted inputs to override instructions.

Injecting malicious data into training to corrupt model behavior.

Recreating model functionality via repeated querying.

Category

Adversarial Manipulation

Adversarial Manipulation

Model and Data Leakage

Lifecycle Stage(s)

Deployment

Data, Training

Deployment

OWASP 2025

LLM01:2025 Prompt Injection

LLM04:2025 Data and Model Poisoning

LLM02:2025 Sensitive Information Disclosure

MITRE ATLAS*

AML.T0051 – LLM Prompt Injection

AML.T0020 – Poison Training Data

AML.T0024.002 – Extract AI Model

Model Inversion

Overreliance on Output

Backdoor Injection

Insecure Output Handling

Training Data Leakage

Insufficient Monitoring

Lack of Auditability

Logic Bombs

Hallucinated Advice

Reconstructing training data from model outputs.

Assuming model responses are correct without validation.

Training a model with hidden triggers for malicious behavior.

Not sanitizing or controlling model responses before display.

Exposure of sensitive or proprietary data used during training.

Failure to track and respond to model behavior post- deployment.

Inability to trace how an AI system made a decision.

Embedded triggers in a model that activate under specific conditions.

Confident but fabricated responses that mislead users.

Model and Data Leakage

Misuse and Overreliance

Adversarial Manipulation

Misuse and Overreliance

Model and Data Leakage

Observability and Response Gaps

Accountability and Governance Risk

Adversarial Manipulation

Misuse and Overreliance

Deployment

Deployment, Monitoring

Training

Deployment

Data, Training

Monitoring

Evaluation, Monitoring

Training, Deployment

Deployment

LLM02:2025 Sensitive Information Disclosure

LLM10:2025 Unbounded Consumption

LLM04:2025 Data and Model Poisoning

LLM05:2025 Improper Output Handling

LLM02:2025 Sensitive Information Disclosure

LLM04:2025 Data and Model Poisoning

LLM09:2025 Misinformation

AML.T0024.001 – Invert AI Model

AML.T0048.003 – External Harms: User Harm

AML.T0018 – Manipulate AI Model

AML.T0067 – LLM Trusted Output Components Manipulation

AML.T0057 – LLM Data Leakage

AML.T0063 – Discover AI Model Outputs

AML.T0015 – Evade AI Model

AML.T0018.000 – Poison AI Model

AML.T0067.000 – LLM Trusted Output Manipulation

1 4

Technique / Risk Definition Category Lifecycle Stage(s) OWASP 2025 MITRE ATLAS*

Insecure Access Control

Lack of fi ne-grained access restrictions to AI systems or data.

Infrastructure and Access Risks

Deployment LLM05:2025 Improper Output Handling

AML.T0012 – Valid Accounts

Unsafe Fine- tuning

Fine-tuning models without proper evaluation or safeguards.

Infrastructure and Access Risks

Training LLM04:2025 Data and Model Poisoning

AML.T0017.000 – Develop Capabilities: Adversarial AI Attacks

Lack of Human Oversight

No human-in-the-loop review of high-risk AI decisions.

Accountability and Governance Risk

Deployment, Monitoring

LLM10:2025 Unbounded Consumption

AML.T0048.003 – External Harms: User Harm

Supply Chain Compromise

Insertion of malicious artifacts or poisoned data via dependencies.

Infrastructure and Access Risks

Build, Train, Deploy

LLM03:2025 Supply Chain

AML.T0010 – AI Supply Chain Compromise

Jailbreak via Prompt Injection

Using prompt injections to bypass LLM guardrails.

Adversarial Manipulation

Deployment LLM01:2025 Prompt Injection

AML.T0054 – LLM Jailbreak

System Prompt Leakage

Exfi ltrating hidden instructions embedded in LLMs.

Model and Data Leakage

Deployment LLM07:2025 System Prompt Leakage

AML.T0056 – Extract LLM System Prompt

RAG Poisoning Contaminating external knowledge sources in retrieval-augmented generation.

Adversarial Manipulation

Training, Deployment

LLM08:2025 Vector and Embedding Weaknesses

AML.T0070 – RAG Poisoning

False RAG Entry Injection

Injecting documents that trick the LLM into treating false data as real context.

Adversarial Manipulation

Deployment LLM08:2025 Vector and Embedding Weaknesses

AML.T0071 – False RAG Entry Injection

Plugin Exploitation

Abusing or compromising plugins connected to LLMs.

Infrastructure and Access Risks

Deployment LLM06:2025 Excessive Agency

AML.T0053 – LLM Plugin Compromise

Unsecured Credentials

Exposed API keys or credentials used in model pipelines.

Infrastructure and Access Risks

Deployment LLM02:2025 Sensitive Information Disclosure

AML.T0055 – Unsecured Credentials

Cost Harvesting Using adversarial input to inflate model inference costs.

Impact / Abuse of Service

Deployment LLM10:2025 Unbounded Consumption

AML.T0034 – Cost Harvesting

Evasion via Adversarial Input

Crafting input that intentionally bypasses model predictions.

Adversarial Manipulation

Deployment LLM01:2025 Prompt Injection

AML.T0015 – Evade AI Model

Bias and Discrimination

Generation of harmful, unfair, or biased outputs.

Bias, Harm, and Social Impact

Training, Deployment

LLM09:2025 Misinformation

AML.T0048.002 – External Harms: Societal Harm

* To learn more about each of the ATLAS techniques and explore them easily, you can use the ATLAS Navigator.

1 5

https://mitre-atlas.github.io/atlas-navigator/

Lifecycle Coverage Map

AI systems don’t become risky only at runtime.

Security risks and policy blind spots emerge at every stage of the AI lifecycle: from dataset

curation and fine-tuning to plugin integrations and user interaction. Understanding when

these risks appear is just as important as understanding what they are.

This section maps the seven risk categories introduced earlier to the typical lifecycle stages

of an AI product.

It helps teams pinpoint:

Where in the lifecycle each risk emerges

When guardrails, red teaming, or governance actions are most effective

How OWASP and ATLAS view risk timing differently

Lifecycle Stages

These are the high-level lifecycle stages used across this guide:

Stage Description

Data

Training

Build

Deployment

Monitoring

Governance

Collection, curation, and storage of raw and labeled datasets

Model pretraining, fine-tuning, and internal evaluation

Integration of models with applications, APIs, plugins, and infrastructure

External exposure of the model to users or other systems

Ongoing observation, validation, and feedback after deployment

Auditability, documentation, and policy-setting across all other stages

w w w . l a k e r a . a i 11 6

Category-by-Stage Coverage Map

The table below maps each AI risk category to the stages of the AI lifecycle where that risk is

most likely to emerge or require mitigation.

A means the risk typically originates or is most effectively addressed at that stage.

An empty cell means that category is not strongly associated with that lifecycle stage.

This overview helps teams see not just what the risks are, but when they need to pay attention to

them.

Risk Category Data Training Build Deployment Monitoring Governance

Adversarial Manipulation

Model and Data Leakage

Misuse and Overreliance

Infrastructure Risks

Observability Gaps

Accountability & Governance

Bias and Harm

*

* The risk itself usually begins earlier.

Notes:

Adversarial threats span nearly every stage, from poisoning during data collection to prompt

injection at runtime.

Observability and governance gaps often show up only after deployment, when it’s often too

late to patch them without significant disruption.

OWASP is heavily focused on Deployment and Build, while MITRE ATLAS spans all stages in

greater detail.

Some risk categories (like Bias and Harm) are cross-cutting and require attention across the

entire lifecycle, especially in regulated environments.

w w w . l a k e r a . a i 11 7

Who Should Use What?

Security risks in AI systems touch multiple teams: security engineers, ML teams, product

leads, compliance officers, and not everyone needs the same framework or the same level of

detail.

This section helps you match the right framework to the right stakeholder. Whether you’re

red teaming an AI product, shaping security policy, or ensuring compliance with new

regulations, there’s a framework that speaks your language (and your needs).

Framework Fit Matrix

Security Engineers & Red Teams

ML Practitioners & Builders

Product & Platform Teams

Compliance 
 & Governance

Framework

MITRE ATLAS

OWASP Top 10 for LLM Applications

NIST AI RMF

EU AI Act

Explanation & Guidance

MITRE ATLAS
 Ideal for teams conducting technical threat modeling, red teaming, or LLM-specific risk

assessments. Covers a wide range of attack techniques and lifecycle stages.

Great for hands-on security practitioners

Less actionable for policy or product teams without translation

w w w . l a k e r a . a i 11 8

OWASP Top 10 for LLM Applications (2025)
 Practical, high-level risk checklist that bridges the gap between AppSec, ML, and platform

teams. Helps identify common pitfalls in real-world AI systems.

Easy to use across teams

May lack depth for nuanced or low-level threats

NIST AI Risk Management Framework (RMF)
 Provides governance, documentation, and accountability scaffolding. Most useful for policy-

driven orgs or compliance-heavy industries.

Strong alignment with responsible AI and ISO standards

Light on actionable technical threat detail

EU AI Act
 Focused on legal and regulatory obligations, especially around foundation models and high-

risk use cases.

Essential for compliance and policy planning

Requires translation into security or dev team actions

w w w . l a k e r a . a i 11 9

Key Takeaways

The AI risk landscape is evolving fast and no single framework captures everything.

But taken together, frameworks like MITRE ATLAS, OWASP Top 10 for LLM Applications

(2025), and NIST AI RMF give us a solid foundation for understanding how AI systems

break, where risks emerge, and what defenses actually matter.

Here’s what to keep in mind as you navigate this space:

1. You don’t need to use every framework

Choose the ones that match your goals.

Building LLM apps? Start with OWASP.

Running red teams or risk assessments? Dive into MITRE ATLAS.

Need governance and accountability? Look to NIST or the EU AI Act.

2. Risk happens across the entire lifecycle

Don’t wait until deployment to start thinking about security. LLMs are intrinsically

hackable so security needs to be designed into the system from the start.

Data curation, model fine-tuning, and plugin integration are all entry points for

adversaries.

2 0

3. AI risks aren’t just technical

Prompt injection is just one piece of the puzzle.

Overreliance, observability gaps, and governance blind spots are equally dangerous, and

often easier to overlook.

4. The risks are new but the mindset isn’t

Good AI security draws from both software security and ML safety. It often looks more like

social engineering though than technical exploitation.

Think like an attacker. Think like a compliance officer. Think like a user.

5. You now have a map

This guide gives you a shared language for assessing AI risks, aligned with the best and

most current frameworks.

Use it to evaluate your systems, guide red teaming, train your team, and stay ahead of

what’s next.

2 1


Item Type: pdf