Site search

Find architecture, research, and terms

Start typing to search the editorial index.

Production guidanceAdvanced

Security and Governance

Runtime threat modeling, prompt injection, least privilege, isolation, egress control, approval gates, evidence, and ownership.

MIR treats security as an execution-loop concern. The runtime must assume that model outputs, retrieved content, connector responses, memories, and peer-agent messages can be wrong or adversarial. Direct and indirect prompt injection remain material risks because untrusted data and instructions can enter the same model context. Source: OWASP

Key takeaways

  • Do not grant a model ambient authority.
  • Separate data, instructions, identity, credentials, and side-effect decisions.
  • Use defense in depth; no single classifier or prompt is a complete control.

Threat-to-control mapping

ThreatFailure pathControlsStatus
Indirect prompt injectionRetrieved content manipulates the agentTreat external content as untrusted data; isolate instructions; constrain tools; require approval for high-impact actionsProduction practice + active research
Overprivileged toolsAgent can act beyond the current objectiveDefault deny, scoped credentials, permission classes, resource-level authorizationProduction practice
Credential leakageSecrets enter prompts, logs, or tool outputVault-issued short-lived credentials; redaction; secret-free evidenceProduction practice
Data exfiltrationTool or connector sends sensitive content outwardEgress allowlists, DLP, data minimization, destination bindingProduction practice
Runaway loopsAgent consumes unbounded time or resourcesStep, token, cost, time, and tool budgets; circuit breaker; stop authorityProduction practice
Poisoned memoryStale or adversarial memory affects future runsProvenance, scopes, confidence, review, correction, expirationProduction pattern
Silent side effectsExternal state changes without reviewable traceTyped actions, checkpoints, approval gates, evidence eventsProduction practice
Cross-agent trust failurePeer agent is treated as inherently trustedMutual identity, bounded delegation, schema validation, independent policyEvolving practice

Identity and dynamic least privilege

Every run should have an attributable requester, runtime identity, tenant, and delegated authority. Tools should receive short-lived credentials scoped to the active action, not permanent keys embedded in prompts or agent memory. Authorization should be evaluated after the model proposes an action and before the tool executes it.

  • Default-deny tool and network access.
  • Separate read, draft, reversible write, and irreversible write permissions.
  • Bind credentials to subject, audience, action, resource, and time.
  • Revoke credentials on pause, failure, termination, or policy change.

Human oversight and incident response

Human-in-the-loop is most useful at consequential decision boundaries, not as continuous token supervision. Approval requests should show the proposed action, affected resources, evidence, alternatives, rollback path, and unresolved uncertainty. The runtime should also support emergency stop, credential revocation, evidence sealing, workspace isolation, and post-incident review.

Governance ownership matrix

Decision Primary owner Runtime responsibility
Acceptable use and risk appetite Business and governance Encode enforceable policy classes
Tool authority and secrets Security and platform Issue scoped credentials and log decisions
Model and prompt quality AI engineering Version, test, route, and monitor
Data retention and memory Privacy and data governance Enforce scopes, deletion, and export
Incident response Security operations and service owner Stop, isolate, preserve evidence, and recover

NIST AI RMF provides a broader governance structure; MIR is one place where resulting controls can become executable. Source: NIST AI RMF

Source record

References

Suggest a correction
  1. OWASP GenAI Security Project. OWASP. Published 2025; last reviewed 2026-06-20 UTC. Security guidance.

  2. OWASP Agentic Security Initiative. OWASP. Published Current guidance; last reviewed 2026-06-20 UTC. Security guidance.

  3. National Institute of Standards and Technology. NIST. Published 2023-01-26; last reviewed 2026-06-20 UTC. Government framework.

  4. National Institute of Standards and Technology. NIST. Published 2024-07-26; last reviewed 2026-06-20 UTC. Government profile.

  5. Model Context Protocol project. Model Context Protocol. Published 2025-11-25; last reviewed 2026-06-24 UTC. Protocol specification.