Securing Agentic AI: Threat Models and Trust Boundaries for LLM-Based Agents and Tool-Use Protocols (2025)

Authors

Keywords:

agentic AI, large language models, Model Context Protocol, Agent2Agent, prompt injection, tool poisoning, trust boundaries, AI governance

Abstract

Background: 2025 turned large language models from chat systems into agents — systems that read content, decide on actions, and invoke privileged tools. Two interoperability protocols industrialized this shift: Anthropic's Model Context Protocol (MCP), whose June 2025 revision re-specified MCP servers as OAuth 2.1 resource servers, and Google's Agent2Agent (A2A) protocol, donated to the Linux Foundation in June 2025 with broad industry backing. The same year produced the attack record that defines the threat model: Invariant Labs' tool-poisoning disclosure (April 2025) and GitHub-MCP "toxic agent flow" exploit (May 2025), and the formalization of the "lethal trifecta" — private data, untrusted content, and external communication combined in one agent (June 2025). Objective: We consolidate the 2025 agentic-AI security record into an engineering threat model for tool-using agents and evaluate the mitigations that the protocol layer, the platform layer, and application design can supply. Methods: Qualitative synthesis of the 2024–2025 primary disclosures, protocol specifications, and governance instruments; construction of a six-class attack taxonomy and a six-class mitigation-coverage assessment. Results: The defining property of agentic systems is boundary collapse: untrusted content becomes instructions that drive privileged actions, so the classical separation between "data" and "execution" — the foundation of most security architecture — does not hold. Every major 2025 exploit is an instance of one pattern; mitigations partition cleanly into classes that reduce blast radius (capability-scoped tools, OAuth-scoped delegation, confirmation gates) and classes that detect misuse (provenance labeling, toxic-flow analyzers), but no 2025 mechanism eliminates the confused-deputy problem itself. Conclusions: Agentic-AI security in 2025 is an exercise in boundary engineering under an acknowledged residual risk : scope every capability, bind identities to delegation chains, gate irreversible actions, and instrument for detection — while treating prompt injection as unsolved and designing so that its exploitation is survivable.

References

1. Anthropic and the Model Context Protocol community, "Model Context Protocol Specification, revision 2025-06-18," Jun. 18, 2025. [Online]. Available: https://modelcontextprotocol.io/specification/2025-06-18

2. Invariant Labs, "MCP Security Notification: Tool Poisoning Attacks," Apr. 1, 2025. [Online]. Available: https://invariantlabs.ai/blog/mcp-security-notification-tool-poisoning-attacks

3. Invariant Labs, "GitHub MCP Exploited: Accessing private repositories via MCP," May 26, 2025. [Online]. Available: https://invariantlabs.ai/blog/mcp-github-vulnerability

4. S. Willison, "The lethal trifecta for AI agents: private data, untrusted content, and external communication," simonwillison.net, Jun. 16, 2025. [Online]. Available: https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/

5. The Linux Foundation, "Linux Foundation Launches the Agent2Agent Protocol Project to Enable Secure, Intelligent Communication Between AI Agents," Jun. 23, 2025. [Online]. Available: https://www.linuxfoundation.org/press/linux-foundation-launches-the-agent2agent-protocol-project-to-enable-secure-intelligent-communication-between-ai-agents

6. Regulation (EU) 2024/1689 of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act), OJ L, 12 Jul. 2024 (general-purpose AI obligations applicable from 2 Aug. 2025).

7. NIST, "Artificial Intelligence Risk Management Framework (AI RMF 1.0)," NIST AI 100-1, Jan. 2023. doi: 10.6028/NIST.AI.100-1.

8. NIST, "Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile," NIST AI 600-1, Jul. 2024. doi: 10.6028/NIST.AI.600-1.

9. K. Greshake, S. Abdelnabi, S. Mishra, C. Endres, T. Holz, and M. Fritz, "Not what you've signed up for: compromising real-world LLM-integrated applications with indirect prompt injection," in Proc. 16th ACM Workshop on Artificial Intelligence and Security (AISec '23), 2023. [Online]. Available: https://arxiv.org/abs/2302.12173

10. D. Hardt and B. Campbell, "Resource Indicators for OAuth 2.0," IETF RFC 8707, Apr. 2020. doi: 10.17487/RFC8707.

11. A. Parecki, T. Lodderstedt, E. Sachs, and A. Dey, "OAuth 2.0 Authorization Framework: OAuth 2.1" (draft-ietf-oauth-v2-1), IETF Internet-Draft, 2025. [Online]. Available: https://datatracker.ietf.org/doc/draft-ietf-oauth-v2-1/

12. OWASP Foundation, "OWASP Top 10 for Large Language Model Applications," GenAI Security Project, 2025. [Online]. Available: https://genai.owasp.org/

Downloads

Published

2026-10-29